[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:09 dist-test-slave-6nmv krb5kdc[19700](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:09 dist-test-slave-6nmv krb5kdc[19700](info): set up 2 sockets
Aug 12 00:05:09 dist-test-slave-6nmv krb5kdc[19700](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 00:05:10.950309 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[19700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:05:11.064851 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:40913
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:40913
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:11.140974 19719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:11.141192 19719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:11.141230 19719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:11.142338 19719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:11.142392 19719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:11.142413 19719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:11.142444 19719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:11.142477 19719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:11.143857 19719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:40913
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:40913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:11.144114 19719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:11.144308 19719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:11.149186 19726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:11.149236 19728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:11.149276 19724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:11.149319 19719 server_base.cc:1034] running on GCE node
I20260812 00:05:11.149531 19719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:11.149770 19719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:11.150970 19719 hybrid_clock.cc:648] HybridClock initialized: now 1786493111150954 us; error 31 us; skew 500 ppm
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[19700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493111, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:11.153352 19719 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:05:11.153749 19719 webserver.cc:460] Webserver started at http://127.19.59.126:32901/ using document root <none> and password file <none>
I20260812 00:05:11.153952 19719 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:11.153995 19719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:11.154075 19719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:11.155047 19719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "981a61b4a3ef46d99801bc96af13ff19"
format_stamp: "Formatted at 2026-08-12 00:05:11 on dist-test-slave-6nmv"
server_key: "9a570be7279220fcfbc9954eeca2df30"
server_key_iv: "53420d4a299941ce917371ceddd9bd32"
server_key_version: "encryptionkey@0"
I20260812 00:05:11.155375 19719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "981a61b4a3ef46d99801bc96af13ff19"
format_stamp: "Formatted at 2026-08-12 00:05:11 on dist-test-slave-6nmv"
server_key: "9a570be7279220fcfbc9954eeca2df30"
server_key_iv: "53420d4a299941ce917371ceddd9bd32"
server_key_version: "encryptionkey@0"
I20260812 00:05:11.156620 19719 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:11.157228 19736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:11.157380 19719 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:11.157469 19719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "981a61b4a3ef46d99801bc96af13ff19"
format_stamp: "Formatted at 2026-08-12 00:05:11 on dist-test-slave-6nmv"
server_key: "9a570be7279220fcfbc9954eeca2df30"
server_key_iv: "53420d4a299941ce917371ceddd9bd32"
server_key_version: "encryptionkey@0"
I20260812 00:05:11.157517 19719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:11.178658 19719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:11.181012 19719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:11.181152 19719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:11.184765 19719 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:40913
I20260812 00:05:11.184859 19803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:40913 every 8 connection(s)
I20260812 00:05:11.185144 19719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:11.186015 19804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:11.187948 19804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19: Bootstrap starting.
I20260812 00:05:11.188434 19804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:11.188648 19804 log.cc:824] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:11.189265 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 19719
I20260812 00:05:11.189363 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:11.189456 19804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19: No bootstrap required, opened a new log
I20260812 00:05:11.190117 19693 external_mini_cluster.cc:1428] Setting key b07d21cd0db80ad6d1e3bf64c688f51a
I20260812 00:05:11.191645 19804 raft_consensus.cc:348] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "981a61b4a3ef46d99801bc96af13ff19" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40913 } }
I20260812 00:05:11.191818 19804 raft_consensus.cc:374] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:11.191855 19804 raft_consensus.cc:729] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 981a61b4a3ef46d99801bc96af13ff19, State: Initialized, Role: FOLLOWER
I20260812 00:05:11.191999 19804 consensus_queue.cc:260] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "981a61b4a3ef46d99801bc96af13ff19" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40913 } }
I20260812 00:05:11.192076 19804 raft_consensus.cc:388] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:11.192111 19804 raft_consensus.cc:482] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:11.192157 19804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:11.193179 19804 raft_consensus.cc:504] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "981a61b4a3ef46d99801bc96af13ff19" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40913 } }
I20260812 00:05:11.193279 19804 leader_election.cc:302] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 981a61b4a3ef46d99801bc96af13ff19; no voters:
I20260812 00:05:11.193430 19804 leader_election.cc:288] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:11.193475 19812 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:11.193603 19812 raft_consensus.cc:686] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [term 1 LEADER]: Becoming Leader. State: Replica: 981a61b4a3ef46d99801bc96af13ff19, State: Running, Role: LEADER
I20260812 00:05:11.193650 19804 sys_catalog.cc:564] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:11.193683 19812 consensus_queue.cc:237] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "981a61b4a3ef46d99801bc96af13ff19" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40913 } }
I20260812 00:05:11.194022 19815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "981a61b4a3ef46d99801bc96af13ff19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "981a61b4a3ef46d99801bc96af13ff19" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40913 } } }
I20260812 00:05:11.194109 19815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:11.194013 19812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 981a61b4a3ef46d99801bc96af13ff19. Latest consensus state: current_term: 1 leader_uuid: "981a61b4a3ef46d99801bc96af13ff19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "981a61b4a3ef46d99801bc96af13ff19" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40913 } } }
I20260812 00:05:11.194289 19812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19 [sys.catalog]: This master's current role is: LEADER
W20260812 00:05:11.195400 19835 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:05:11.195459 19835 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:05:11.196420 19820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:11.196601 19820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:11.198071 19820 catalog_manager.cc:1347] Generated new cluster ID: c9665a9055b34272a2595ea0c5e8fd35
I20260812 00:05:11.198122 19820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[19700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:11.205570 19808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:11.190983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60560 (local address 127.19.59.126:40913)
0812 00:05:11.193790 (+ 2807us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:11.193798 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:11.193864 (+ 66us) server_negotiation.cc:407] Connection header received
0812 00:05:11.193964 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:11.193970 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:11.194017 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:11.194142 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:11.196380 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.197373 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.198699 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.199081 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.199179 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:11.202414 (+ 3235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:11.202418 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:11.202418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:11.202428 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:11.203930 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:11.204311 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:11.204314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:11.204314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:11.204404 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:11.204631 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:11.204632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:11.204633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:11.204828 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:11.204985 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:11.205209 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 00:05:11.205323 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2765,"thread_start_us":84,"threads_started":1}
I20260812 00:05:11.211680 19820 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:11.212184 19820 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:11.214805 19820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 981a61b4a3ef46d99801bc96af13ff19: Generated new TSK 0
I20260812 00:05:11.214943 19820 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:05:11.248145 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40913
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:11.333339 19841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:11.333514 19841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:11.333536 19841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:11.334614 19841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:11.334656 19841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:11.334681 19841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:05:11.336345 19841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40913
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:11.336561 19841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:11.336767 19841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:11.341188 19846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:11.341224 19847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:11.341190 19850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:11.341224 19841 server_base.cc:1034] running on GCE node
I20260812 00:05:11.341568 19841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:11.341791 19841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:11.342969 19841 hybrid_clock.cc:648] HybridClock initialized: now 1786493111342976 us; error 42 us; skew 500 ppm
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[19700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493111, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:11.345256 19841 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:05:11.345618 19841 webserver.cc:460] Webserver started at http://127.19.59.65:35439/ using document root <none> and password file <none>
I20260812 00:05:11.345880 19841 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:11.345945 19841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:11.346099 19841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:11.347033 19841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "0ef15ea2c24246d7b82b95738725a8dd"
format_stamp: "Formatted at 2026-08-12 00:05:11 on dist-test-slave-6nmv"
server_key: "a3cfc24ec1b0297e77aab576673fbdfe"
server_key_iv: "56f1a3c20da8aa5906dc046e2bc35f01"
server_key_version: "encryptionkey@0"
I20260812 00:05:11.347357 19841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "0ef15ea2c24246d7b82b95738725a8dd"
format_stamp: "Formatted at 2026-08-12 00:05:11 on dist-test-slave-6nmv"
server_key: "a3cfc24ec1b0297e77aab576673fbdfe"
server_key_iv: "56f1a3c20da8aa5906dc046e2bc35f01"
server_key_version: "encryptionkey@0"
I20260812 00:05:11.348554 19841 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:05:11.349159 19857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:11.349308 19841 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:11.349383 19841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "0ef15ea2c24246d7b82b95738725a8dd"
format_stamp: "Formatted at 2026-08-12 00:05:11 on dist-test-slave-6nmv"
server_key: "a3cfc24ec1b0297e77aab576673fbdfe"
server_key_iv: "56f1a3c20da8aa5906dc046e2bc35f01"
server_key_version: "encryptionkey@0"
I20260812 00:05:11.349459 19841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:11.385872 19841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:11.387349 19841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:11.387486 19841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:11.387686 19841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:11.387943 19841 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:11.387988 19841 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:11.388018 19841 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:11.388041 19841 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:11.394371 19841 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:44141
I20260812 00:05:11.394423 19991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:44141 every 8 connection(s)
I20260812 00:05:11.394704 19841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[19700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493111, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:11.403244 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 19841
I20260812 00:05:11.403273 19808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:11.395467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:53809 (local address 127.19.59.126:40913)
0812 00:05:11.395531 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:11.395533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:11.395790 (+ 257us) server_negotiation.cc:407] Connection header received
0812 00:05:11.396297 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:11.396298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:11.396310 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:11.396361 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:11.397359 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.397867 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.398688 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.398887 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.398958 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:11.400707 (+ 1749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:11.400708 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:11.400708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:11.400715 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:11.402049 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:11.402408 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:11.402410 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:11.402410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:11.402470 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:11.402699 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:11.402700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:11.402700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:11.402800 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:11.402863 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:11.403095 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 00:05:11.403193 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 00:05:11.403333 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:11.403393 19994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:11.395442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:40913 (local address 127.19.59.65:53809)
0812 00:05:11.395655 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:11.395699 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:11.396187 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:11.396420 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:11.396423 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:11.397089 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:11.397253 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:11.397256 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.397935 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.397936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:11.398608 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:11.398610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.398970 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.398971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:11.399071 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:11.399438 (+ 367us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:11.399445 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:11.400621 (+ 1176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:11.402133 (+ 1512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:11.402140 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:11.402141 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:11.402338 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:11.402529 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:11.402530 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:11.402530 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:11.402624 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:11.402855 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:11.402860 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:11.402985 (+ 125us) client_negotiation.cc:769] Sending connection context
0812 00:05:11.403075 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 00:05:11.403207 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":147,"threads_started":1}
I20260812 00:05:11.403473 19693 external_mini_cluster.cc:1428] Setting key 89e5e864eb9a03545d809f5c4d1597d4
I20260812 00:05:11.403895 19992 heartbeater.cc:347] Connected to a master server at 127.19.59.126:40913
I20260812 00:05:11.403975 19992 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:11.404150 19992 heartbeater.cc:511] Master 127.19.59.126:40913 requested a full tablet report, sending...
I20260812 00:05:11.404608 19758 ts_manager.cc:194] Registered new tserver with Master: 0ef15ea2c24246d7b82b95738725a8dd (127.19.59.65:44141)
I20260812 00:05:11.405120 19758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:53809
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:05:11.428568 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40913
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:11.512539 19998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:11.512750 19998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:11.512799 19998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:11.513882 19998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:11.513949 19998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:11.513993 19998 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:05:11.515296 19998 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40913
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:11.515532 19998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:11.515759 19998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:11.520267 20004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:11.520346 19998 server_base.cc:1034] running on GCE node
W20260812 00:05:11.520287 20006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:11.520295 20003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:11.520690 19998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:11.520941 19998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:11.522071 19998 hybrid_clock.cc:648] HybridClock initialized: now 1786493111522060 us; error 30 us; skew 500 ppm
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[19700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493111, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:11.524507 19998 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:05:11.524869 19998 webserver.cc:460] Webserver started at http://127.19.59.66:42325/ using document root <none> and password file <none>
I20260812 00:05:11.525087 19998 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:11.525130 19998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:11.525259 19998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:11.526207 19998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "880f1f38481042c5b53c16aebd015e2b"
format_stamp: "Formatted at 2026-08-12 00:05:11 on dist-test-slave-6nmv"
server_key: "35e2b76eeddfc79a1e9f990c59ce2f8d"
server_key_iv: "81f26284e1deaa93167f3ce93ff91bad"
server_key_version: "encryptionkey@0"
I20260812 00:05:11.526543 19998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "880f1f38481042c5b53c16aebd015e2b"
format_stamp: "Formatted at 2026-08-12 00:05:11 on dist-test-slave-6nmv"
server_key: "35e2b76eeddfc79a1e9f990c59ce2f8d"
server_key_iv: "81f26284e1deaa93167f3ce93ff91bad"
server_key_version: "encryptionkey@0"
I20260812 00:05:11.527776 19998 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:11.528452 20013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:11.528602 19998 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:11.528703 19998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "880f1f38481042c5b53c16aebd015e2b"
format_stamp: "Formatted at 2026-08-12 00:05:11 on dist-test-slave-6nmv"
server_key: "35e2b76eeddfc79a1e9f990c59ce2f8d"
server_key_iv: "81f26284e1deaa93167f3ce93ff91bad"
server_key_version: "encryptionkey@0"
I20260812 00:05:11.528785 19998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:11.550648 19998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:11.553056 19998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:11.553196 19998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:11.553395 19998 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:11.553692 19998 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:11.553726 19998 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:11.553762 19998 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:11.553788 19998 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:11.560604 19998 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:33161
I20260812 00:05:11.560659 20148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:33161 every 8 connection(s)
I20260812 00:05:11.560978 19998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:11.563644 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 19998
I20260812 00:05:11.563745 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:11.563959 19693 external_mini_cluster.cc:1428] Setting key 1fc89d44c7f5edb034b5b32673e405a7
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[19700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493111, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:11.570195 20151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:11.561622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:40913 (local address 127.19.59.66:42805)
0812 00:05:11.561791 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:11.561866 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:11.562290 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:11.562463 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:11.562466 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:11.562988 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:11.563148 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:11.563152 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.563826 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.563827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:11.564762 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:11.564765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.565256 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.565256 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:11.565350 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:11.565803 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:11.565831 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:11.567311 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:11.568995 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:11.569001 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:11.569002 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:11.569181 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:11.569370 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:11.569370 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:11.569370 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:11.569457 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:11.569746 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:11.569750 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:11.569882 (+ 132us) client_negotiation.cc:769] Sending connection context
0812 00:05:11.569957 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:05:11.570055 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":96,"threads_started":1}
I20260812 00:05:11.570245 19808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:11.561661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:42805 (local address 127.19.59.126:40913)
0812 00:05:11.561734 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:11.561736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:11.561954 (+ 218us) server_negotiation.cc:407] Connection header received
0812 00:05:11.562362 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:11.562363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:11.562372 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:11.562417 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:11.563217 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.563708 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.564839 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.565135 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.565248 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:11.567421 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:11.567422 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:11.567423 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:11.567429 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:11.568919 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:11.569237 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:11.569238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:11.569239 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:11.569306 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:11.569516 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:11.569517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:11.569518 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:11.569684 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:11.569760 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:11.570006 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 00:05:11.570095 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 00:05:11.570819 20149 heartbeater.cc:347] Connected to a master server at 127.19.59.126:40913
I20260812 00:05:11.570930 20149 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:11.571105 20149 heartbeater.cc:511] Master 127.19.59.126:40913 requested a full tablet report, sending...
I20260812 00:05:11.571472 19758 ts_manager.cc:194] Registered new tserver with Master: 880f1f38481042c5b53c16aebd015e2b (127.19.59.66:33161)
I20260812 00:05:11.572005 19758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:42805
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:05:11.592397 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40913
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:11.670642 20154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:11.670830 20154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:11.670871 20154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:11.671936 20154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:11.671972 20154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:11.671998 20154 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:05:11.673302 20154 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40913
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:11.673460 20154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:11.673606 20154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:11.678247 20159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:11.678382 20154 server_base.cc:1034] running on GCE node
W20260812 00:05:11.678293 20160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:11.678272 20162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:11.678696 20154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:11.678946 20154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:11.680076 20154 hybrid_clock.cc:648] HybridClock initialized: now 1786493111680063 us; error 27 us; skew 500 ppm
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[19700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493111, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:11.682435 20154 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:05:11.682865 20154 webserver.cc:460] Webserver started at http://127.19.59.67:43675/ using document root <none> and password file <none>
I20260812 00:05:11.683104 20154 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:11.683194 20154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:11.683334 20154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:11.684409 20154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "3634fac14af94d8f9b312a11cba5e128"
format_stamp: "Formatted at 2026-08-12 00:05:11 on dist-test-slave-6nmv"
server_key: "c0259db97c921c0a09ff133a86f4f5aa"
server_key_iv: "3357248eda53962d6e2698317f0412d2"
server_key_version: "encryptionkey@0"
I20260812 00:05:11.684733 20154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "3634fac14af94d8f9b312a11cba5e128"
format_stamp: "Formatted at 2026-08-12 00:05:11 on dist-test-slave-6nmv"
server_key: "c0259db97c921c0a09ff133a86f4f5aa"
server_key_iv: "3357248eda53962d6e2698317f0412d2"
server_key_version: "encryptionkey@0"
I20260812 00:05:11.685962 20154 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:05:11.686641 20171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:11.686807 20154 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:11.686906 20154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "3634fac14af94d8f9b312a11cba5e128"
format_stamp: "Formatted at 2026-08-12 00:05:11 on dist-test-slave-6nmv"
server_key: "c0259db97c921c0a09ff133a86f4f5aa"
server_key_iv: "3357248eda53962d6e2698317f0412d2"
server_key_version: "encryptionkey@0"
I20260812 00:05:11.686980 20154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:11.705350 20154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:11.707363 20154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:11.707515 20154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:11.707746 20154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:11.708048 20154 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:11.708097 20154 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:11.708133 20154 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:11.708159 20154 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:11.714577 20154 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:44855
I20260812 00:05:11.714612 20312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:44855 every 8 connection(s)
I20260812 00:05:11.714989 20154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:11.717242 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 20154
I20260812 00:05:11.717316 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:11.717439 19693 external_mini_cluster.cc:1428] Setting key ea0fb79356b8362023d53910acdedf80
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[19700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493111, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:11.723359 19808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:11.715647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:33421 (local address 127.19.59.126:40913)
0812 00:05:11.715691 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:11.715693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:11.715904 (+ 211us) server_negotiation.cc:407] Connection header received
0812 00:05:11.716311 (+ 407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:11.716312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:11.716321 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:11.716367 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:11.717147 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.717794 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.718836 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.719015 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.719063 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:11.721014 (+ 1951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:11.721016 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:11.721016 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:11.721022 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:11.722294 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:11.722650 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:11.722651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:11.722651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:11.722700 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:11.722905 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:11.722906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:11.722906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:11.723001 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:11.723046 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:11.723245 (+ 199us) server_negotiation.cc:299] Negotiation successful
0812 00:05:11.723303 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:05:11.723591 20316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:11.715635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:40913 (local address 127.19.59.67:33421)
0812 00:05:11.715780 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:11.715809 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:11.716237 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:11.716410 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:11.716412 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:11.716905 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:11.717059 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:11.717063 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.717899 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.717900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:11.718760 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:11.718762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.719078 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.719078 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:11.719164 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:11.719546 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:11.719552 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:11.720932 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:11.722372 (+ 1440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:11.722378 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:11.722380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:11.722586 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:11.722753 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:11.722753 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:11.722754 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:11.722849 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:11.723051 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:11.723055 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:11.723148 (+ 93us) client_negotiation.cc:769] Sending connection context
0812 00:05:11.723225 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:05:11.723332 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":84,"threads_started":1}
I20260812 00:05:11.724076 20313 heartbeater.cc:347] Connected to a master server at 127.19.59.126:40913
I20260812 00:05:11.724172 20313 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:11.724344 20313 heartbeater.cc:511] Master 127.19.59.126:40913 requested a full tablet report, sending...
I20260812 00:05:11.724695 19758 ts_manager.cc:194] Registered new tserver with Master: 3634fac14af94d8f9b312a11cba5e128 (127.19.59.67:44855)
I20260812 00:05:11.725026 19758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:33421
I20260812 00:05:11.729247 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[19700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493111, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[19700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493111, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.59.65@KRBTEST.COM
I20260812 00:05:11.751484 20321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:11.744490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39996 (local address 127.19.59.65:44141)
0812 00:05:11.744662 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:11.744666 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:11.744676 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:11.744701 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:11.744703 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:11.744717 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:11.744784 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:11.745264 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.746070 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.746748 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.747039 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.747097 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:11.749098 (+ 2001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:11.749105 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:11.749105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:11.749111 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:11.750442 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:11.750727 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:11.750730 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:11.750730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:11.750780 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:11.750953 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:11.750953 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:11.750954 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:11.751071 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:11.751187 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:11.751274 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 00:05:11.751337 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":85,"threads_started":1}
W20260812 00:05:11.751829 19884 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39996
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[19700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[19700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.65@KRBTEST.COM
I20260812 00:05:11.773540 20321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:11.766777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40004 (local address 127.19.59.65:44141)
0812 00:05:11.766846 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:11.766848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:11.766942 (+ 94us) server_negotiation.cc:407] Connection header received
0812 00:05:11.767017 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:11.767018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:11.767031 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:11.767079 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:11.767653 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.768146 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.768852 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:11.769073 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:11.769141 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:11.771411 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:11.771413 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:11.771413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:11.771419 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:11.772653 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:11.772987 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:11.772988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:11.772988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:11.773037 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:11.773190 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:11.773191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:11.773191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:11.773274 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:11.773364 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:11.773427 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 00:05:11.773480 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 00:05:11.774085 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 19841
I20260812 00:05:11.783318 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 19998
I20260812 00:05:11.790799 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 20154
I20260812 00:05:11.797748 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 19719
2026-08-12T00:05:11Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (1942 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[20328](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[20328](info): set up 2 sockets
Aug 12 00:05:11 dist-test-slave-6nmv krb5kdc[20328](info): commencing operation
krb5kdc: starting...
W20260812 00:05:12.884974 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:05:12 dist-test-slave-6nmv krb5kdc[20328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:05:13.012331 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:37743
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:37875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:37743
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:13.090962 20341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:13.091171 20341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:13.091193 20341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:13.092342 20341 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:13.092384 20341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:13.092398 20341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:13.092411 20341 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:13.092423 20341 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:13.093871 20341 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:37743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:37743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:13.094110 20341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:13.094321 20341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:13.098940 20347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:13.098968 20352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:13.098963 20348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:13.099224 20341 server_base.cc:1034] running on GCE node
I20260812 00:05:13.099449 20341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:13.099730 20341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:13.100903 20341 hybrid_clock.cc:648] HybridClock initialized: now 1786493113100893 us; error 32 us; skew 500 ppm
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493113, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:13.103381 20341 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:05:13.103734 20341 webserver.cc:460] Webserver started at http://127.19.59.126:45755/ using document root <none> and password file <none>
I20260812 00:05:13.103929 20341 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:13.103968 20341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:13.104056 20341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:13.104974 20341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "333d9c5f9fa54fc088e5647b8629cf67"
format_stamp: "Formatted at 2026-08-12 00:05:13 on dist-test-slave-6nmv"
server_key: "554ea30b95526f898e39782a5c08b525"
server_key_iv: "a08ca43b20aa0db8c61b5590b629a6ed"
server_key_version: "encryptionkey@0"
I20260812 00:05:13.105270 20341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "333d9c5f9fa54fc088e5647b8629cf67"
format_stamp: "Formatted at 2026-08-12 00:05:13 on dist-test-slave-6nmv"
server_key: "554ea30b95526f898e39782a5c08b525"
server_key_iv: "a08ca43b20aa0db8c61b5590b629a6ed"
server_key_version: "encryptionkey@0"
I20260812 00:05:13.106845 20341 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:13.107508 20359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:13.107699 20341 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:13.107796 20341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "333d9c5f9fa54fc088e5647b8629cf67"
format_stamp: "Formatted at 2026-08-12 00:05:13 on dist-test-slave-6nmv"
server_key: "554ea30b95526f898e39782a5c08b525"
server_key_iv: "a08ca43b20aa0db8c61b5590b629a6ed"
server_key_version: "encryptionkey@0"
I20260812 00:05:13.107878 20341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:13.121381 20341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:13.123522 20341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:13.123679 20341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:13.127707 20341 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:37743
I20260812 00:05:13.127765 20419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:37743 every 8 connection(s)
I20260812 00:05:13.128136 20341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:13.129065 20420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:13.131423 20420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67: Bootstrap starting.
I20260812 00:05:13.132018 20420 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:13.132310 20420 log.cc:824] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:13.133021 20420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67: No bootstrap required, opened a new log
I20260812 00:05:13.134696 20420 raft_consensus.cc:348] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "333d9c5f9fa54fc088e5647b8629cf67" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 37743 } }
I20260812 00:05:13.134840 20420 raft_consensus.cc:374] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:13.134879 20420 raft_consensus.cc:729] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 333d9c5f9fa54fc088e5647b8629cf67, State: Initialized, Role: FOLLOWER
I20260812 00:05:13.135048 20420 consensus_queue.cc:260] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "333d9c5f9fa54fc088e5647b8629cf67" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 37743 } }
I20260812 00:05:13.135130 20420 raft_consensus.cc:388] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:13.135176 20420 raft_consensus.cc:482] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:13.135224 20420 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:13.135773 20420 raft_consensus.cc:504] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "333d9c5f9fa54fc088e5647b8629cf67" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 37743 } }
I20260812 00:05:13.135912 20420 leader_election.cc:302] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 333d9c5f9fa54fc088e5647b8629cf67; no voters:
I20260812 00:05:13.136102 20420 leader_election.cc:288] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:13.136157 20423 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:13.136337 20423 raft_consensus.cc:686] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [term 1 LEADER]: Becoming Leader. State: Replica: 333d9c5f9fa54fc088e5647b8629cf67, State: Running, Role: LEADER
I20260812 00:05:13.136379 20420 sys_catalog.cc:564] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:13.136433 20423 consensus_queue.cc:237] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "333d9c5f9fa54fc088e5647b8629cf67" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 37743 } }
I20260812 00:05:13.136812 20425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 333d9c5f9fa54fc088e5647b8629cf67. Latest consensus state: current_term: 1 leader_uuid: "333d9c5f9fa54fc088e5647b8629cf67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "333d9c5f9fa54fc088e5647b8629cf67" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 37743 } } }
I20260812 00:05:13.136902 20425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:13.136992 20424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "333d9c5f9fa54fc088e5647b8629cf67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "333d9c5f9fa54fc088e5647b8629cf67" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 37743 } } }
I20260812 00:05:13.137066 20424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:13.137251 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 20341
I20260812 00:05:13.137331 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:13.137496 19693 external_mini_cluster.cc:1428] Setting key 7f648921bf7845a3a413520076229f0f
I20260812 00:05:13.138245 20431 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:13.138808 20431 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:13.140334 20431 catalog_manager.cc:1347] Generated new cluster ID: 20017517cd0f4ac88a376b15b41fe714
I20260812 00:05:13.140393 20431 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:13.148950 20431 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:13.149582 20431 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:13.150431 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.137966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50598 (local address 127.19.59.126:37743)
0812 00:05:13.138161 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:13.138171 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:13.139485 (+ 1314us) server_negotiation.cc:407] Connection header received
0812 00:05:13.139641 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:13.139647 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:13.139732 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:13.139870 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:13.140684 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.142075 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.143160 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.143734 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.143823 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.146783 (+ 2960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:13.146787 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:13.146787 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:13.146800 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:13.148799 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.149219 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.149221 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.149222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.149327 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.149538 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.149539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.149539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.149798 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:13.149971 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:13.150080 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 00:05:13.150214 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":87,"threads_started":1}
I20260812 00:05:13.152558 20431 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 333d9c5f9fa54fc088e5647b8629cf67: Generated new TSK 0
I20260812 00:05:13.152716 20431 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:05:13.186558 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:37743
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:37875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:13.285313 20448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:13.285521 20448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:13.285545 20448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:13.286665 20448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:13.286718 20448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:13.286741 20448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:05:13.288164 20448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:37743
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:13.288373 20448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:13.288590 20448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:13.294150 20459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:13.294126 20456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:13.294121 20455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:13.294405 20448 server_base.cc:1034] running on GCE node
I20260812 00:05:13.294611 20448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:13.294826 20448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:13.295976 20448 hybrid_clock.cc:648] HybridClock initialized: now 1786493113295974 us; error 38 us; skew 500 ppm
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493113, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:13.298455 20448 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:05:13.298871 20448 webserver.cc:460] Webserver started at http://127.19.59.65:35883/ using document root <none> and password file <none>
I20260812 00:05:13.299124 20448 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:13.299196 20448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:13.299343 20448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:13.300329 20448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "8af7e0a857d54b5782896e5d3d64d71c"
format_stamp: "Formatted at 2026-08-12 00:05:13 on dist-test-slave-6nmv"
server_key: "9e5ff7acbc8e457ae1f3d266d149b8d1"
server_key_iv: "133727e0d0d2fc33b940ac5e86a21532"
server_key_version: "encryptionkey@0"
I20260812 00:05:13.300705 20448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "8af7e0a857d54b5782896e5d3d64d71c"
format_stamp: "Formatted at 2026-08-12 00:05:13 on dist-test-slave-6nmv"
server_key: "9e5ff7acbc8e457ae1f3d266d149b8d1"
server_key_iv: "133727e0d0d2fc33b940ac5e86a21532"
server_key_version: "encryptionkey@0"
I20260812 00:05:13.302109 20448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 00:05:13.302850 20467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:13.303004 20448 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:13.303093 20448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "8af7e0a857d54b5782896e5d3d64d71c"
format_stamp: "Formatted at 2026-08-12 00:05:13 on dist-test-slave-6nmv"
server_key: "9e5ff7acbc8e457ae1f3d266d149b8d1"
server_key_iv: "133727e0d0d2fc33b940ac5e86a21532"
server_key_version: "encryptionkey@0"
I20260812 00:05:13.303164 20448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:13.317200 20448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:13.319119 20448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:13.319278 20448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:13.319510 20448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:13.319805 20448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:13.319856 20448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:13.319890 20448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:13.319916 20448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:13.325661 20448 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:39023
I20260812 00:05:13.325731 20605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:39023 every 8 connection(s)
I20260812 00:05:13.326048 20448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493113, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:13.332104 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 20448
I20260812 00:05:13.332192 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:13.332360 19693 external_mini_cluster.cc:1428] Setting key b475dd8696a46f50cbd9f84cfb6392fb
I20260812 00:05:13.335314 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.326761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:49427 (local address 127.19.59.126:37743)
0812 00:05:13.326858 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:13.326860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:13.327010 (+ 150us) server_negotiation.cc:407] Connection header received
0812 00:05:13.327970 (+ 960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:13.327971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:13.327981 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:13.328041 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:13.328631 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.329098 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.330057 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.330253 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.330311 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.332521 (+ 2210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:13.332522 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:13.332523 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:13.332530 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:13.333919 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.334307 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.334309 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.334309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.334368 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.334663 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.334665 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.334665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.334796 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:13.334856 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:13.335167 (+ 311us) server_negotiation.cc:299] Negotiation successful
0812 00:05:13.335239 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 00:05:13.335623 20609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.326721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:37743 (local address 127.19.59.65:49427)
0812 00:05:13.326891 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:13.326929 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:13.327864 (+ 935us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:13.328114 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:13.328117 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:13.328364 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:13.328537 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.328541 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.329188 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.329188 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.329988 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.329990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.330324 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.330325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.330415 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.330906 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:13.330914 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:13.332439 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:13.333993 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:13.334000 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:13.334002 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:13.334222 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:13.334434 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:13.334435 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:13.334435 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:13.334576 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:13.334861 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:13.334866 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:13.335027 (+ 161us) client_negotiation.cc:769] Sending connection context
0812 00:05:13.335146 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 00:05:13.335323 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":97,"threads_started":1}
I20260812 00:05:13.336119 20606 heartbeater.cc:347] Connected to a master server at 127.19.59.126:37743
I20260812 00:05:13.336218 20606 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:13.336382 20606 heartbeater.cc:511] Master 127.19.59.126:37743 requested a full tablet report, sending...
I20260812 00:05:13.336887 20378 ts_manager.cc:194] Registered new tserver with Master: 8af7e0a857d54b5782896e5d3d64d71c (127.19.59.65:39023)
I20260812 00:05:13.337570 20378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:49427
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:05:13.358574 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:37743
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:37875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:13.440246 20613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:13.440474 20613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:13.440513 20613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:13.441675 20613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:13.441745 20613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:13.441794 20613 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:05:13.443318 20613 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:37743
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:13.443579 20613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:13.443804 20613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:13.448760 20619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:13.448793 20621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:13.448807 20618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:13.448969 20613 server_base.cc:1034] running on GCE node
I20260812 00:05:13.449178 20613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:13.449388 20613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:13.450531 20613 hybrid_clock.cc:648] HybridClock initialized: now 1786493113450517 us; error 26 us; skew 500 ppm
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493113, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:13.453658 20613 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:05:13.454164 20613 webserver.cc:460] Webserver started at http://127.19.59.66:46091/ using document root <none> and password file <none>
I20260812 00:05:13.454439 20613 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:13.454502 20613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:13.454627 20613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:13.455693 20613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "d07b4579bc2a4885a81d107891597798"
format_stamp: "Formatted at 2026-08-12 00:05:13 on dist-test-slave-6nmv"
server_key: "164e7b5b3ca042a379f4bda2959665ca"
server_key_iv: "57748aeaad77d2fec2a67bdde1d67ebc"
server_key_version: "encryptionkey@0"
I20260812 00:05:13.456035 20613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "d07b4579bc2a4885a81d107891597798"
format_stamp: "Formatted at 2026-08-12 00:05:13 on dist-test-slave-6nmv"
server_key: "164e7b5b3ca042a379f4bda2959665ca"
server_key_iv: "57748aeaad77d2fec2a67bdde1d67ebc"
server_key_version: "encryptionkey@0"
I20260812 00:05:13.457194 20613 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:05:13.457800 20628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:13.458029 20613 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:13.458117 20613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "d07b4579bc2a4885a81d107891597798"
format_stamp: "Formatted at 2026-08-12 00:05:13 on dist-test-slave-6nmv"
server_key: "164e7b5b3ca042a379f4bda2959665ca"
server_key_iv: "57748aeaad77d2fec2a67bdde1d67ebc"
server_key_version: "encryptionkey@0"
I20260812 00:05:13.458191 20613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:13.470925 20613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:13.472659 20613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:13.472820 20613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:13.473031 20613 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:13.473326 20613 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:13.473376 20613 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:13.473407 20613 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:13.473439 20613 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:13.479151 20613 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:38825
I20260812 00:05:13.479220 20763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:38825 every 8 connection(s)
I20260812 00:05:13.479492 20613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:13.483237 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 20613
I20260812 00:05:13.483342 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:13.483501 19693 external_mini_cluster.cc:1428] Setting key 3c645171168a688953de9788bfbc4fe0
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493113, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:13.488845 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.480194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:44293 (local address 127.19.59.126:37743)
0812 00:05:13.480242 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:13.480244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:13.480430 (+ 186us) server_negotiation.cc:407] Connection header received
0812 00:05:13.481303 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:13.481304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:13.481315 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:13.481365 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:13.481966 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.482462 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.483389 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.483589 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.483656 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.485729 (+ 2073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:13.485730 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:13.485731 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:13.485739 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:13.487255 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.487810 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.487811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.487812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.487867 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.488206 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.488207 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.488207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.488327 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:13.488388 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:13.488725 (+ 337us) server_negotiation.cc:299] Negotiation successful
0812 00:05:13.488787 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:05:13.489192 20766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.480169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:37743 (local address 127.19.59.66:44293)
0812 00:05:13.480325 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:13.480355 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:13.481207 (+ 852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:13.481422 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:13.481425 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:13.481662 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:13.481862 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.481865 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.482536 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.482537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.483293 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.483295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.483667 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.483668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.483788 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.484316 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:13.484324 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:13.485636 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:13.487371 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:13.487380 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:13.487382 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:13.487727 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:13.487955 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:13.487956 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:13.487957 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:13.488122 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:13.488397 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:13.488403 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:13.488577 (+ 174us) client_negotiation.cc:769] Sending connection context
0812 00:05:13.488695 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 00:05:13.488888 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":82,"threads_started":1}
I20260812 00:05:13.489693 20764 heartbeater.cc:347] Connected to a master server at 127.19.59.126:37743
I20260812 00:05:13.489778 20764 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:13.489995 20764 heartbeater.cc:511] Master 127.19.59.126:37743 requested a full tablet report, sending...
I20260812 00:05:13.490403 20378 ts_manager.cc:194] Registered new tserver with Master: d07b4579bc2a4885a81d107891597798 (127.19.59.66:38825)
I20260812 00:05:13.490767 20378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:44293
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:05:13.512305 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:37743
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:37875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:13.589841 20769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:13.590054 20769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:13.590090 20769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:13.591254 20769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:13.591313 20769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:13.591358 20769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:05:13.592830 20769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:37743
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:13.593065 20769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:13.593266 20769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:13.597797 20774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:13.597874 20777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:13.597874 20775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:13.598014 20769 server_base.cc:1034] running on GCE node
I20260812 00:05:13.598213 20769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:13.598412 20769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:13.599551 20769 hybrid_clock.cc:648] HybridClock initialized: now 1786493113599535 us; error 31 us; skew 500 ppm
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493113, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:13.601895 20769 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:05:13.602340 20769 webserver.cc:460] Webserver started at http://127.19.59.67:33725/ using document root <none> and password file <none>
I20260812 00:05:13.602545 20769 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:13.602603 20769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:13.602722 20769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:13.603606 20769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "0809acf6f6bc434598d708a82bc117ce"
format_stamp: "Formatted at 2026-08-12 00:05:13 on dist-test-slave-6nmv"
server_key: "17f4f5fc4607ea5e7b4f33d8146270f6"
server_key_iv: "74079a8b7906137e8e504f110aefef60"
server_key_version: "encryptionkey@0"
I20260812 00:05:13.603933 20769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "0809acf6f6bc434598d708a82bc117ce"
format_stamp: "Formatted at 2026-08-12 00:05:13 on dist-test-slave-6nmv"
server_key: "17f4f5fc4607ea5e7b4f33d8146270f6"
server_key_iv: "74079a8b7906137e8e504f110aefef60"
server_key_version: "encryptionkey@0"
I20260812 00:05:13.605099 20769 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:13.605783 20785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:13.605931 20769 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:13.606014 20769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "0809acf6f6bc434598d708a82bc117ce"
format_stamp: "Formatted at 2026-08-12 00:05:13 on dist-test-slave-6nmv"
server_key: "17f4f5fc4607ea5e7b4f33d8146270f6"
server_key_iv: "74079a8b7906137e8e504f110aefef60"
server_key_version: "encryptionkey@0"
I20260812 00:05:13.606083 20769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:13.620633 20769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:13.622481 20769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:13.622639 20769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:13.622853 20769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:13.623175 20769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:13.623237 20769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:13.623322 20769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:13.623353 20769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:13.629786 20769 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:36983
I20260812 00:05:13.629859 20918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:36983 every 8 connection(s)
I20260812 00:05:13.630223 20769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493113, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:13.636783 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 20769
I20260812 00:05:13.636886 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:13.637049 19693 external_mini_cluster.cc:1428] Setting key 3ddedfd66c2dc074516519f23e485adc
I20260812 00:05:13.639469 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.630925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:59503 (local address 127.19.59.126:37743)
0812 00:05:13.631033 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:13.631036 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:13.631212 (+ 176us) server_negotiation.cc:407] Connection header received
0812 00:05:13.632171 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:13.632173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:13.632188 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:13.632259 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:13.632896 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.633359 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.634439 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.634633 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.634681 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.636604 (+ 1923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:13.636605 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:13.636605 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:13.636611 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:13.638171 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.638616 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.638617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.638617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.638669 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.638866 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.638866 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.638866 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.638962 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:13.639009 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:13.639327 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 00:05:13.639412 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 00:05:13.639647 20921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.630879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:37743 (local address 127.19.59.67:59503)
0812 00:05:13.631085 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:13.631130 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:13.632052 (+ 922us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:13.632321 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:13.632325 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:13.632591 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:13.632763 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.632768 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.633490 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.633491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.634349 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.634352 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.634700 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.634701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.634827 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.635242 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:13.635249 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:13.636527 (+ 1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:13.638234 (+ 1707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:13.638239 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:13.638241 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:13.638548 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:13.638730 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:13.638730 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:13.638730 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:13.638819 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:13.639043 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:13.639048 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:13.639205 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 00:05:13.639304 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 00:05:13.639432 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":109,"threads_started":1}
I20260812 00:05:13.640081 20919 heartbeater.cc:347] Connected to a master server at 127.19.59.126:37743
I20260812 00:05:13.640180 20919 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:13.640343 20919 heartbeater.cc:511] Master 127.19.59.126:37743 requested a full tablet report, sending...
I20260812 00:05:13.640663 20378 ts_manager.cc:194] Registered new tserver with Master: 0809acf6f6bc434598d708a82bc117ce (127.19.59.67:36983)
I20260812 00:05:13.641044 20378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:59503
I20260812 00:05:13.648559 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:05:13.655238 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.650030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50604 (local address 127.19.59.126:37743)
0812 00:05:13.650073 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:13.650075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:13.650179 (+ 104us) server_negotiation.cc:407] Connection header received
0812 00:05:13.650245 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:13.650245 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:13.650254 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:13.650300 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:13.650790 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.651247 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.651937 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.652142 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.652212 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.653259 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:13.653260 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:13.653260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:13.653266 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:13.654445 (+ 1179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.654705 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.654706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.654706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.654750 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.654893 (+ 143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.654893 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.654893 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.654999 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:13.655060 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:13.655140 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 00:05:13.655187 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:05:13.657091 20378 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50604:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:13.658767 20378 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:13.665059 20932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.660813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:36983 (local address 127.0.0.1:33186)
0812 00:05:13.660979 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:13.661024 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:13.661103 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:13.661429 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:13.661433 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:13.661436 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:13.661529 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.661530 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.663093 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.663094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.664020 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.664022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.664847 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.664848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.664899 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.664908 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 00:05:13.664959 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:05:13.664993 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":43,"thread_start_us":58,"threads_started":1}
I20260812 00:05:13.665100 20934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.660889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33186 (local address 127.19.59.67:36983)
0812 00:05:13.661171 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:13.661176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:13.661187 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:05:13.661232 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:13.661235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:13.661251 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:13.661337 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:13.661728 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.662792 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.664099 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.664772 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.664847 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.664899 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:13.664972 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 00:05:13.665013 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":90,"threads_started":1}
I20260812 00:05:13.665586 20935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.660847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:38825 (local address 127.0.0.1:52640)
0812 00:05:13.661336 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:13.661348 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:13.661395 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:13.661583 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:13.661584 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:13.661585 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:13.661625 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.661626 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.662908 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.662909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.664249 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.664251 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.665077 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.665078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.665422 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.665425 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:13.665489 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 00:05:13.665527 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"mutex_wait_us":55,"thread_start_us":106,"threads_started":1}
I20260812 00:05:13.665635 20937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.661260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52640 (local address 127.19.59.66:38825)
0812 00:05:13.661464 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:13.661467 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:13.661475 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:13.661506 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:13.661507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:13.661519 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:13.661581 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:13.661703 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.662792 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.664325 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.665002 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.665066 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.665212 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:13.665517 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 00:05:13.665556 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":93,"threads_started":1}
I20260812 00:05:13.665751 20843 tablet_service.cc:1467] Processing CreateTablet for tablet ce21617a8f9147cfbdef8c222d4e4ef4 (DEFAULT_TABLE table=test-table [id=efcb837add484887857e6023e468b5dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:13.666157 20843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce21617a8f9147cfbdef8c222d4e4ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:13.666441 20684 tablet_service.cc:1467] Processing CreateTablet for tablet ce21617a8f9147cfbdef8c222d4e4ef4 (DEFAULT_TABLE table=test-table [id=efcb837add484887857e6023e468b5dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:13.666718 20684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce21617a8f9147cfbdef8c222d4e4ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:13.668525 20938 tablet_bootstrap.cc:492] T ce21617a8f9147cfbdef8c222d4e4ef4 P 0809acf6f6bc434598d708a82bc117ce: Bootstrap starting.
I20260812 00:05:13.669004 20939 tablet_bootstrap.cc:492] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798: Bootstrap starting.
I20260812 00:05:13.669149 20933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.661058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:39023 (local address 127.0.0.1:55696)
0812 00:05:13.661690 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:13.661700 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:13.661768 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:13.662095 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:13.662096 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:13.662099 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:13.662150 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.662151 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.662964 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.662965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.664226 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.664242 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.666056 (+ 1814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.666057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.666123 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.668944 (+ 2821us) client_negotiation.cc:769] Sending connection context
0812 00:05:13.669034 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 00:05:13.669084 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"mutex_wait_us":37,"thread_start_us":84,"threads_started":1}
I20260812 00:05:13.669196 20936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.661161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55696 (local address 127.19.59.65:39023)
0812 00:05:13.661352 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:13.661357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:13.661852 (+ 495us) server_negotiation.cc:407] Connection header received
0812 00:05:13.661899 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:13.661901 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:13.661931 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:13.662002 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:13.662245 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.662856 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.665249 (+ 2393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.665979 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.666052 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.666100 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:13.669057 (+ 2957us) server_negotiation.cc:299] Negotiation successful
0812 00:05:13.669111 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":84,"threads_started":1}
I20260812 00:05:13.669219 20938 tablet_bootstrap.cc:654] T ce21617a8f9147cfbdef8c222d4e4ef4 P 0809acf6f6bc434598d708a82bc117ce: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:13.669727 20938 log.cc:824] T ce21617a8f9147cfbdef8c222d4e4ef4 P 0809acf6f6bc434598d708a82bc117ce: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:13.669974 20939 tablet_bootstrap.cc:654] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:13.669888 20523 tablet_service.cc:1467] Processing CreateTablet for tablet ce21617a8f9147cfbdef8c222d4e4ef4 (DEFAULT_TABLE table=test-table [id=efcb837add484887857e6023e468b5dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:13.670195 20523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce21617a8f9147cfbdef8c222d4e4ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:13.670527 20939 log.cc:824] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:13.670552 20938 tablet_bootstrap.cc:492] T ce21617a8f9147cfbdef8c222d4e4ef4 P 0809acf6f6bc434598d708a82bc117ce: No bootstrap required, opened a new log
I20260812 00:05:13.670616 20938 ts_tablet_manager.cc:1397] T ce21617a8f9147cfbdef8c222d4e4ef4 P 0809acf6f6bc434598d708a82bc117ce: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:05:13.671183 20939 tablet_bootstrap.cc:492] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798: No bootstrap required, opened a new log
I20260812 00:05:13.671259 20939 ts_tablet_manager.cc:1397] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:05:13.672560 20939 raft_consensus.cc:348] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0809acf6f6bc434598d708a82bc117ce" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36983 } } peers { permanent_uuid: "8af7e0a857d54b5782896e5d3d64d71c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 39023 } } peers { permanent_uuid: "d07b4579bc2a4885a81d107891597798" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38825 } }
I20260812 00:05:13.672605 20938 raft_consensus.cc:348] T ce21617a8f9147cfbdef8c222d4e4ef4 P 0809acf6f6bc434598d708a82bc117ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0809acf6f6bc434598d708a82bc117ce" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36983 } } peers { permanent_uuid: "8af7e0a857d54b5782896e5d3d64d71c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 39023 } } peers { permanent_uuid: "d07b4579bc2a4885a81d107891597798" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38825 } }
I20260812 00:05:13.672719 20939 raft_consensus.cc:374] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:13.672780 20939 raft_consensus.cc:729] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d07b4579bc2a4885a81d107891597798, State: Initialized, Role: FOLLOWER
I20260812 00:05:13.672782 20938 raft_consensus.cc:374] T ce21617a8f9147cfbdef8c222d4e4ef4 P 0809acf6f6bc434598d708a82bc117ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:13.672816 20938 raft_consensus.cc:729] T ce21617a8f9147cfbdef8c222d4e4ef4 P 0809acf6f6bc434598d708a82bc117ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0809acf6f6bc434598d708a82bc117ce, State: Initialized, Role: FOLLOWER
I20260812 00:05:13.672885 20939 consensus_queue.cc:260] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0809acf6f6bc434598d708a82bc117ce" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36983 } } peers { permanent_uuid: "8af7e0a857d54b5782896e5d3d64d71c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 39023 } } peers { permanent_uuid: "d07b4579bc2a4885a81d107891597798" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38825 } }
I20260812 00:05:13.672959 20938 consensus_queue.cc:260] T ce21617a8f9147cfbdef8c222d4e4ef4 P 0809acf6f6bc434598d708a82bc117ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0809acf6f6bc434598d708a82bc117ce" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36983 } } peers { permanent_uuid: "8af7e0a857d54b5782896e5d3d64d71c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 39023 } } peers { permanent_uuid: "d07b4579bc2a4885a81d107891597798" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38825 } }
I20260812 00:05:13.673189 20764 heartbeater.cc:503] Master 127.19.59.126:37743 was elected leader, sending a full tablet report...
I20260812 00:05:13.673234 20938 ts_tablet_manager.cc:1428] T ce21617a8f9147cfbdef8c222d4e4ef4 P 0809acf6f6bc434598d708a82bc117ce: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:05:13.673374 20919 heartbeater.cc:503] Master 127.19.59.126:37743 was elected leader, sending a full tablet report...
I20260812 00:05:13.673486 20947 tablet_bootstrap.cc:492] T ce21617a8f9147cfbdef8c222d4e4ef4 P 8af7e0a857d54b5782896e5d3d64d71c: Bootstrap starting.
I20260812 00:05:13.673179 20939 ts_tablet_manager.cc:1428] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:05:13.674134 20947 tablet_bootstrap.cc:654] T ce21617a8f9147cfbdef8c222d4e4ef4 P 8af7e0a857d54b5782896e5d3d64d71c: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:13.674667 20947 log.cc:824] T ce21617a8f9147cfbdef8c222d4e4ef4 P 8af7e0a857d54b5782896e5d3d64d71c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:13.675243 20947 tablet_bootstrap.cc:492] T ce21617a8f9147cfbdef8c222d4e4ef4 P 8af7e0a857d54b5782896e5d3d64d71c: No bootstrap required, opened a new log
I20260812 00:05:13.675294 20947 ts_tablet_manager.cc:1397] T ce21617a8f9147cfbdef8c222d4e4ef4 P 8af7e0a857d54b5782896e5d3d64d71c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:05:13.676519 20947 raft_consensus.cc:348] T ce21617a8f9147cfbdef8c222d4e4ef4 P 8af7e0a857d54b5782896e5d3d64d71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0809acf6f6bc434598d708a82bc117ce" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36983 } } peers { permanent_uuid: "8af7e0a857d54b5782896e5d3d64d71c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 39023 } } peers { permanent_uuid: "d07b4579bc2a4885a81d107891597798" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38825 } }
I20260812 00:05:13.676642 20947 raft_consensus.cc:374] T ce21617a8f9147cfbdef8c222d4e4ef4 P 8af7e0a857d54b5782896e5d3d64d71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:13.676664 20947 raft_consensus.cc:729] T ce21617a8f9147cfbdef8c222d4e4ef4 P 8af7e0a857d54b5782896e5d3d64d71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8af7e0a857d54b5782896e5d3d64d71c, State: Initialized, Role: FOLLOWER
I20260812 00:05:13.676738 20947 consensus_queue.cc:260] T ce21617a8f9147cfbdef8c222d4e4ef4 P 8af7e0a857d54b5782896e5d3d64d71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0809acf6f6bc434598d708a82bc117ce" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36983 } } peers { permanent_uuid: "8af7e0a857d54b5782896e5d3d64d71c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 39023 } } peers { permanent_uuid: "d07b4579bc2a4885a81d107891597798" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38825 } }
I20260812 00:05:13.676928 20947 ts_tablet_manager.cc:1428] T ce21617a8f9147cfbdef8c222d4e4ef4 P 8af7e0a857d54b5782896e5d3d64d71c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:05:13.676967 20606 heartbeater.cc:503] Master 127.19.59.126:37743 was elected leader, sending a full tablet report...
W20260812 00:05:13.730057 20765 tablet.cc:2369] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:05:13.737843 20944 raft_consensus.cc:482] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:13.737959 20944 raft_consensus.cc:504] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0809acf6f6bc434598d708a82bc117ce" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36983 } } peers { permanent_uuid: "8af7e0a857d54b5782896e5d3d64d71c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 39023 } } peers { permanent_uuid: "d07b4579bc2a4885a81d107891597798" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38825 } }
I20260812 00:05:13.738344 20944 leader_election.cc:288] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0809acf6f6bc434598d708a82bc117ce (127.19.59.67:36983), 8af7e0a857d54b5782896e5d3d64d71c (127.19.59.65:39023)
I20260812 00:05:13.741905 20934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.738630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:58111 (local address 127.19.59.67:36983)
0812 00:05:13.738675 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:13.738678 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:13.738687 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:13.738729 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:13.738730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:13.738740 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:13.738786 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:13.738965 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.739653 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.740947 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.741531 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.741610 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.741619 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:13.741775 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 00:05:13.741834 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:05:13.741905 20936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.738727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:37357 (local address 127.19.59.65:39023)
0812 00:05:13.738783 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:13.738785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:13.738903 (+ 118us) server_negotiation.cc:407] Connection header received
0812 00:05:13.738959 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:13.738959 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:13.738972 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:13.739022 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:13.739108 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.739726 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.740932 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.741528 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.741610 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.741619 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:13.741775 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 00:05:13.741833 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:05:13.741909 20766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.738543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:36983 (local address 127.19.59.66:58111)
0812 00:05:13.738614 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:13.738628 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:13.738678 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:13.738797 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:13.738798 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:13.738800 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:13.738876 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.738878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.739723 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.739724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.740846 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.740848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.741616 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.741617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.741694 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.741698 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:13.741757 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 00:05:13.741797 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":13}
I20260812 00:05:13.741915 20951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.738650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:39023 (local address 127.19.59.66:37357)
0812 00:05:13.738835 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:13.738845 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:13.738902 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:13.739023 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:13.739023 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:13.739024 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:13.739070 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.739071 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.739797 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.739797 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.740846 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:13.740848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.741616 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.741617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:13.741694 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.741698 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:13.741757 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 00:05:13.741796 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":47,"thread_start_us":113,"threads_started":1}
I20260812 00:05:13.742268 20545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce21617a8f9147cfbdef8c222d4e4ef4" candidate_uuid: "d07b4579bc2a4885a81d107891597798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af7e0a857d54b5782896e5d3d64d71c" is_pre_election: true
I20260812 00:05:13.742436 20545 raft_consensus.cc:2454] T ce21617a8f9147cfbdef8c222d4e4ef4 P 8af7e0a857d54b5782896e5d3d64d71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d07b4579bc2a4885a81d107891597798 in term 0.
I20260812 00:05:13.742652 20636 leader_election.cc:302] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8af7e0a857d54b5782896e5d3d64d71c, d07b4579bc2a4885a81d107891597798; no voters:
I20260812 00:05:13.742623 20867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce21617a8f9147cfbdef8c222d4e4ef4" candidate_uuid: "d07b4579bc2a4885a81d107891597798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0809acf6f6bc434598d708a82bc117ce" is_pre_election: true
I20260812 00:05:13.742760 20867 raft_consensus.cc:2454] T ce21617a8f9147cfbdef8c222d4e4ef4 P 0809acf6f6bc434598d708a82bc117ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d07b4579bc2a4885a81d107891597798 in term 0.
I20260812 00:05:13.742830 20944 raft_consensus.cc:2781] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:13.742915 20944 raft_consensus.cc:482] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:13.742945 20944 raft_consensus.cc:3037] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:13.743650 20944 raft_consensus.cc:504] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0809acf6f6bc434598d708a82bc117ce" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36983 } } peers { permanent_uuid: "8af7e0a857d54b5782896e5d3d64d71c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 39023 } } peers { permanent_uuid: "d07b4579bc2a4885a81d107891597798" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38825 } }
I20260812 00:05:13.743814 20944 leader_election.cc:288] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [CANDIDATE]: Term 1 election: Requested vote from peers 0809acf6f6bc434598d708a82bc117ce (127.19.59.67:36983), 8af7e0a857d54b5782896e5d3d64d71c (127.19.59.65:39023)
I20260812 00:05:13.743976 20867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce21617a8f9147cfbdef8c222d4e4ef4" candidate_uuid: "d07b4579bc2a4885a81d107891597798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0809acf6f6bc434598d708a82bc117ce"
I20260812 00:05:13.744019 20545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce21617a8f9147cfbdef8c222d4e4ef4" candidate_uuid: "d07b4579bc2a4885a81d107891597798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af7e0a857d54b5782896e5d3d64d71c"
I20260812 00:05:13.744063 20867 raft_consensus.cc:3037] T ce21617a8f9147cfbdef8c222d4e4ef4 P 0809acf6f6bc434598d708a82bc117ce [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:13.744082 20545 raft_consensus.cc:3037] T ce21617a8f9147cfbdef8c222d4e4ef4 P 8af7e0a857d54b5782896e5d3d64d71c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:13.744954 20867 raft_consensus.cc:2454] T ce21617a8f9147cfbdef8c222d4e4ef4 P 0809acf6f6bc434598d708a82bc117ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d07b4579bc2a4885a81d107891597798 in term 1.
I20260812 00:05:13.744964 20545 raft_consensus.cc:2454] T ce21617a8f9147cfbdef8c222d4e4ef4 P 8af7e0a857d54b5782896e5d3d64d71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d07b4579bc2a4885a81d107891597798 in term 1.
I20260812 00:05:13.745111 20636 leader_election.cc:302] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0809acf6f6bc434598d708a82bc117ce, d07b4579bc2a4885a81d107891597798; no voters:
I20260812 00:05:13.745211 20944 raft_consensus.cc:2781] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:13.745352 20944 raft_consensus.cc:686] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [term 1 LEADER]: Becoming Leader. State: Replica: d07b4579bc2a4885a81d107891597798, State: Running, Role: LEADER
I20260812 00:05:13.745460 20944 consensus_queue.cc:237] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0809acf6f6bc434598d708a82bc117ce" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36983 } } peers { permanent_uuid: "8af7e0a857d54b5782896e5d3d64d71c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 39023 } } peers { permanent_uuid: "d07b4579bc2a4885a81d107891597798" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38825 } }
I20260812 00:05:13.746232 20378 catalog_manager.cc:5495] T ce21617a8f9147cfbdef8c222d4e4ef4 P d07b4579bc2a4885a81d107891597798 reported cstate change: term changed from 0 to 1, leader changed from <none> to d07b4579bc2a4885a81d107891597798 (127.19.59.66). New cstate: current_term: 1 leader_uuid: "d07b4579bc2a4885a81d107891597798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0809acf6f6bc434598d708a82bc117ce" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8af7e0a857d54b5782896e5d3d64d71c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 39023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d07b4579bc2a4885a81d107891597798" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38825 } health_report { overall_health: HEALTHY } } }
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.65@KRBTEST.COM
I20260812 00:05:13.764760 20936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.757419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55706 (local address 127.19.59.65:39023)
0812 00:05:13.757489 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:13.757491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:13.757586 (+ 95us) server_negotiation.cc:407] Connection header received
0812 00:05:13.757657 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:13.757658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:13.757667 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:13.757719 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:13.758315 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.758749 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.759427 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.759601 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.759667 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.762135 (+ 2468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:13.762145 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:13.762145 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:13.762152 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:13.763689 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.764030 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.764034 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.764034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.764091 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.764272 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.764273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.764273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.764399 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:13.764560 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:13.764595 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 00:05:13.764666 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493113, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493113, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.59.65@KRBTEST.COM
I20260812 00:05:13.786149 20936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.779892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55710 (local address 127.19.59.65:39023)
0812 00:05:13.779974 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:13.779976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:13.780015 (+ 39us) server_negotiation.cc:407] Connection header received
0812 00:05:13.780058 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:13.780059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:13.780066 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:13.780112 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:13.780596 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.781021 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.781699 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.781923 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.781985 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.784044 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:13.784045 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:13.784045 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:13.784050 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:13.785132 (+ 1082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.785436 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.785437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.785437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.785484 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.785633 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.785633 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.785634 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.785711 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:13.785780 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:13.785967 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 00:05:13.786027 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.65@KRBTEST.COM
I20260812 00:05:13.806596 20936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:13.800519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55720 (local address 127.19.59.65:39023)
0812 00:05:13.800600 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:13.800602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:13.800695 (+ 93us) server_negotiation.cc:407] Connection header received
0812 00:05:13.800731 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:13.800732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:13.800739 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:13.800783 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:13.801288 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.801723 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.802424 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:13.802602 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:13.802642 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:13.804533 (+ 1891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:13.804534 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:13.804534 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:13.804540 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:13.805645 (+ 1105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.805990 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.805991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.805992 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.806039 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:13.806234 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:13.806234 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:13.806234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:13.806312 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:13.806379 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:13.806462 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 00:05:13.806513 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260812 00:05:13.807026 20501 tablet_service.cc:2908] Rejecting scan request for tablet ce21617a8f9147cfbdef8c222d4e4ef4: Uninitialized: clean time has not yet been initialized
I20260812 00:05:13.808046 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 20448
I20260812 00:05:13.815672 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 20613
I20260812 00:05:13.821278 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 20769
I20260812 00:05:13.827491 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 20341
2026-08-12T00:05:13Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2031 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20970](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20970](info): set up 2 sockets
Aug 12 00:05:13 dist-test-slave-6nmv krb5kdc[20970](info): commencing operation
krb5kdc: starting...
W20260812 00:05:14.909433 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:05:14 dist-test-slave-6nmv krb5kdc[20970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:05:15.021152 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:34057
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:34057
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:15.098251 20983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:15.098453 20983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:15.098485 20983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:15.099514 20983 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:15.099579 20983 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 00:05:15.099598 20983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:15.099617 20983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:15.099642 20983 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:15.099661 20983 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:15.100898 20983 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:34057
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:34057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:15.101130 20983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:15.101379 20983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:15.105777 20990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:15.105955 20983 server_base.cc:1034] running on GCE node
W20260812 00:05:15.105840 20991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:15.105867 20993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:15.106274 20983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:15.106565 20983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:15.107713 20983 hybrid_clock.cc:648] HybridClock initialized: now 1786493115107708 us; error 31 us; skew 500 ppm
Aug 12 00:05:15 dist-test-slave-6nmv krb5kdc[20970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493115, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:15.118048 20983 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:05:15.118482 20983 webserver.cc:460] Webserver started at http://127.19.59.126:46671/ using document root <none> and password file <none>
I20260812 00:05:15.118664 20983 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:15.118700 20983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:15.118783 20983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:15.119674 20983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "309a02a2c1774aa0be0ff13725383a54"
format_stamp: "Formatted at 2026-08-12 00:05:15 on dist-test-slave-6nmv"
server_key: "3067eebbf7ce326ffa850da953227502"
server_key_iv: "bfd2d7dde4735b64c70ba81f82358b06"
server_key_version: "encryptionkey@0"
I20260812 00:05:15.119948 20983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "309a02a2c1774aa0be0ff13725383a54"
format_stamp: "Formatted at 2026-08-12 00:05:15 on dist-test-slave-6nmv"
server_key: "3067eebbf7ce326ffa850da953227502"
server_key_iv: "bfd2d7dde4735b64c70ba81f82358b06"
server_key_version: "encryptionkey@0"
I20260812 00:05:15.121109 20983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:15.121795 21001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:15.122002 20983 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:15.122100 20983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "309a02a2c1774aa0be0ff13725383a54"
format_stamp: "Formatted at 2026-08-12 00:05:15 on dist-test-slave-6nmv"
server_key: "3067eebbf7ce326ffa850da953227502"
server_key_iv: "bfd2d7dde4735b64c70ba81f82358b06"
server_key_version: "encryptionkey@0"
I20260812 00:05:15.122154 20983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:15.135430 20983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:15.137369 20983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:15.137462 20983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:15.141624 20983 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:34057
I20260812 00:05:15.141723 21073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:34057 every 8 connection(s)
I20260812 00:05:15.142043 20983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:15.142674 21074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:15.144575 21074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54: Bootstrap starting.
I20260812 00:05:15.145051 21074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:15.145262 21074 log.cc:824] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:15.145474 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 20983
I20260812 00:05:15.145570 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:15.145718 19693 external_mini_cluster.cc:1428] Setting key 1a4dc491dde41845d0af278379085f28
I20260812 00:05:15.145988 21074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54: No bootstrap required, opened a new log
I20260812 00:05:15.148524 21074 raft_consensus.cc:348] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309a02a2c1774aa0be0ff13725383a54" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34057 } }
I20260812 00:05:15.148660 21074 raft_consensus.cc:374] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:15.148689 21074 raft_consensus.cc:729] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 309a02a2c1774aa0be0ff13725383a54, State: Initialized, Role: FOLLOWER
I20260812 00:05:15.148792 21074 consensus_queue.cc:260] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309a02a2c1774aa0be0ff13725383a54" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34057 } }
I20260812 00:05:15.148847 21074 raft_consensus.cc:388] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:15.148870 21074 raft_consensus.cc:482] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:15.148916 21074 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:15.149469 21074 raft_consensus.cc:504] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309a02a2c1774aa0be0ff13725383a54" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34057 } }
I20260812 00:05:15.149549 21074 leader_election.cc:302] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 309a02a2c1774aa0be0ff13725383a54; no voters:
I20260812 00:05:15.149712 21074 leader_election.cc:288] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:15.149736 21081 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:15.149863 21081 raft_consensus.cc:686] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [term 1 LEADER]: Becoming Leader. State: Replica: 309a02a2c1774aa0be0ff13725383a54, State: Running, Role: LEADER
I20260812 00:05:15.149984 21074 sys_catalog.cc:564] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:15.149995 21081 consensus_queue.cc:237] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309a02a2c1774aa0be0ff13725383a54" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34057 } }
I20260812 00:05:15.150547 21083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 309a02a2c1774aa0be0ff13725383a54. Latest consensus state: current_term: 1 leader_uuid: "309a02a2c1774aa0be0ff13725383a54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309a02a2c1774aa0be0ff13725383a54" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34057 } } }
I20260812 00:05:15.150636 21083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:15.150867 21090 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:15.151093 21082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "309a02a2c1774aa0be0ff13725383a54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309a02a2c1774aa0be0ff13725383a54" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34057 } } }
I20260812 00:05:15.151192 21082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:15.151423 21090 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 00:05:15 dist-test-slave-6nmv krb5kdc[20970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:15.154203 21090 catalog_manager.cc:1347] Generated new cluster ID: 99d7e4d179954690ad710d891da805ce
I20260812 00:05:15.154245 21090 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:15.158095 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.146188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48286 (local address 127.19.59.126:34057)
0812 00:05:15.146373 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:15.146382 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:15.146443 (+ 61us) server_negotiation.cc:407] Connection header received
0812 00:05:15.147216 (+ 773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:15.147224 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:15.147279 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:15.147425 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:15.147938 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.149139 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.149959 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.150486 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.150574 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.154758 (+ 4184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:15.154762 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:15.154762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:15.154773 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:15.156585 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.156938 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.156941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.156941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.157068 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.157256 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.157256 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.157257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.157544 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:15.157689 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:15.157764 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 00:05:15.157914 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":88,"threads_started":1}
I20260812 00:05:15.164076 21090 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:15.164556 21090 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:15.174712 21090 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54: Generated new TSK 0
I20260812 00:05:15.174870 21090 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:05:15.204403 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:34057
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:15.287606 21104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:15.287770 21104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:15.287791 21104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:15.288779 21104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:15.288808 21104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:15.288826 21104 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:05:15.288842 21104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:05:15.290122 21104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.59.126:34057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:15.290273 21104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:15.290438 21104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:15.294886 21113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:15.295019 21111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:15.295086 21115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:15.295061 21104 server_base.cc:1034] running on GCE node
I20260812 00:05:15.295349 21104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:15.295562 21104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:15.296720 21104 hybrid_clock.cc:648] HybridClock initialized: now 1786493115296714 us; error 32 us; skew 500 ppm
Aug 12 00:05:15 dist-test-slave-6nmv krb5kdc[20970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493115, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:15.299155 21104 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:05:15.299479 21104 webserver.cc:460] Webserver started at http://127.19.59.65:37887/ using document root <none> and password file <none>
I20260812 00:05:15.299633 21104 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:15.299665 21104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:15.299739 21104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:15.300590 21104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "db8c4054c4ff4eb6b303608661b5281d"
format_stamp: "Formatted at 2026-08-12 00:05:15 on dist-test-slave-6nmv"
server_key: "a5f9314a0ad60bfddd262a9a996eb867"
server_key_iv: "beca7ec647622f43d31658df050faf36"
server_key_version: "encryptionkey@0"
I20260812 00:05:15.300855 21104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "db8c4054c4ff4eb6b303608661b5281d"
format_stamp: "Formatted at 2026-08-12 00:05:15 on dist-test-slave-6nmv"
server_key: "a5f9314a0ad60bfddd262a9a996eb867"
server_key_iv: "beca7ec647622f43d31658df050faf36"
server_key_version: "encryptionkey@0"
I20260812 00:05:15.302104 21104 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:15.302811 21124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:15.302958 21104 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:15.303032 21104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "db8c4054c4ff4eb6b303608661b5281d"
format_stamp: "Formatted at 2026-08-12 00:05:15 on dist-test-slave-6nmv"
server_key: "a5f9314a0ad60bfddd262a9a996eb867"
server_key_iv: "beca7ec647622f43d31658df050faf36"
server_key_version: "encryptionkey@0"
I20260812 00:05:15.303079 21104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:15.314646 21104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:15.316102 21104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:15.316192 21104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:15.316550 21104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:15.316578 21104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:15.316596 21104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:15.316639 21104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:15.322728 21104 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:46743
I20260812 00:05:15.322785 21258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:46743 every 8 connection(s)
I20260812 00:05:15.323096 21104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:05:15 dist-test-slave-6nmv krb5kdc[20970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493115, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:15.326071 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.317068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:53041 (local address 127.19.59.126:34057)
0812 00:05:15.317105 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:15.317107 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:15.317316 (+ 209us) server_negotiation.cc:407] Connection header received
0812 00:05:15.317746 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:15.317747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:15.317759 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:15.317854 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:15.318606 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.319371 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.320701 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.320982 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.321054 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.323642 (+ 2588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:15.323643 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:15.323643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:15.323649 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:15.324947 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.325268 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.325268 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.325269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.325325 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.325570 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.325571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.325571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.325661 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:15.325706 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:15.325958 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 00:05:15.326015 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 00:05:15.326203 21133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.317076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:34057 (local address 127.19.59.65:53041)
0812 00:05:15.317220 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:15.317248 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:15.317645 (+ 397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:15.317923 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:15.317927 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:15.318253 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:15.318511 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.318518 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.319458 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.319460 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.320616 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.320619 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.321057 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.321058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.321147 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.321662 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:15.321671 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:15.323566 (+ 1895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:15.325010 (+ 1444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:15.325015 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:15.325016 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:15.325198 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:15.325394 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:15.325394 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:15.325394 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:15.325522 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:15.325707 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:15.325711 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:15.325865 (+ 154us) client_negotiation.cc:769] Sending connection context
0812 00:05:15.325947 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 00:05:15.326048 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":69,"threads_started":1}
I20260812 00:05:15.326617 21260 heartbeater.cc:347] Connected to a master server at 127.19.59.126:34057
I20260812 00:05:15.326683 21260 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:15.326855 21260 heartbeater.cc:511] Master 127.19.59.126:34057 requested a full tablet report, sending...
I20260812 00:05:15.327363 21021 ts_manager.cc:194] Registered new tserver with Master: db8c4054c4ff4eb6b303608661b5281d (127.19.59.65:46743)
I20260812 00:05:15.328152 21021 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:53041
I20260812 00:05:15.329416 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 21104
I20260812 00:05:15.329515 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:15.329680 19693 external_mini_cluster.cc:1428] Setting key 8fd31b6020fc21d7f70c00b0b344924d
I20260812 00:05:15.332733 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.327585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:44511 (local address 127.19.59.126:34057)
0812 00:05:15.327619 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:15.327621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:15.327727 (+ 106us) server_negotiation.cc:407] Connection header received
0812 00:05:15.327746 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:15.327747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:15.327755 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:15.327814 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:15.328052 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.328547 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.329277 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.329427 (+ 150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.329472 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.330353 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:15.330353 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:15.330354 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:15.330359 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:15.331620 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.331982 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.331983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.331984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.332037 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.332234 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.332235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.332235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.332340 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:15.332422 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:15.332570 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 00:05:15.332633 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:05:15.332741 21267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.327522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:34057 (local address 127.19.59.65:44511)
0812 00:05:15.327655 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:15.327663 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:15.327711 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:15.327816 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:15.327817 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:15.327961 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:15.328002 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.328003 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.328626 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.328627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.329215 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.329217 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.329495 (+ 278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.329496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.329578 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.330007 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:15.330011 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:15.330286 (+ 275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:15.331718 (+ 1432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:15.331719 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:15.331720 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:15.331893 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:15.332107 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:15.332107 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:15.332108 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:15.332167 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:15.332414 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:15.332415 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:15.332471 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 00:05:15.332545 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 00:05:15.332634 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":81,"threads_started":1}
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:05:15.352568 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:34057
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:15.429481 21270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:15.429675 21270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:15.429697 21270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:15.430791 21270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:15.430830 21270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:15.430867 21270 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:05:15.430912 21270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:05:15.432297 21270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.59.126:34057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:15.432523 21270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:15.432736 21270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:15.437419 21277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:15.437427 21280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:15.437493 21278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:15.437718 21270 server_base.cc:1034] running on GCE node
I20260812 00:05:15.437949 21270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:15.438128 21270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:15.439257 21270 hybrid_clock.cc:648] HybridClock initialized: now 1786493115439245 us; error 25 us; skew 500 ppm
Aug 12 00:05:15 dist-test-slave-6nmv krb5kdc[20970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493115, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:15.441668 21270 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:05:15.442198 21270 webserver.cc:460] Webserver started at http://127.19.59.66:45281/ using document root <none> and password file <none>
I20260812 00:05:15.442451 21270 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:15.442497 21270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:15.442617 21270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:15.443583 21270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "9af2163a305844728f52971a5fb63a8d"
format_stamp: "Formatted at 2026-08-12 00:05:15 on dist-test-slave-6nmv"
server_key: "9f12cea7ce20186bd03aaf3ad69577d5"
server_key_iv: "27a9d8c322ae285930f0333ad14a3365"
server_key_version: "encryptionkey@0"
I20260812 00:05:15.443931 21270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "9af2163a305844728f52971a5fb63a8d"
format_stamp: "Formatted at 2026-08-12 00:05:15 on dist-test-slave-6nmv"
server_key: "9f12cea7ce20186bd03aaf3ad69577d5"
server_key_iv: "27a9d8c322ae285930f0333ad14a3365"
server_key_version: "encryptionkey@0"
I20260812 00:05:15.445218 21270 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:15.445907 21288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:15.446074 21270 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:15.446156 21270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "9af2163a305844728f52971a5fb63a8d"
format_stamp: "Formatted at 2026-08-12 00:05:15 on dist-test-slave-6nmv"
server_key: "9f12cea7ce20186bd03aaf3ad69577d5"
server_key_iv: "27a9d8c322ae285930f0333ad14a3365"
server_key_version: "encryptionkey@0"
I20260812 00:05:15.446226 21270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:15.460289 21270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:15.463018 21270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:15.463121 21270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:15.463634 21270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:15.463680 21270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:15.463706 21270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:15.463752 21270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:15.470314 21270 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:39593
I20260812 00:05:15.470382 21424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:39593 every 8 connection(s)
Aug 12 00:05:15 dist-test-slave-6nmv krb5kdc[20970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493115, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:15.470709 21270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:15.473582 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.464030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:56379 (local address 127.19.59.126:34057)
0812 00:05:15.464078 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:15.464079 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:15.464300 (+ 221us) server_negotiation.cc:407] Connection header received
0812 00:05:15.464793 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:15.464794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:15.464808 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:15.464859 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:15.465667 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.466526 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.468068 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.468393 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.468457 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.471137 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:15.471139 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:15.471139 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:15.471148 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:15.472389 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.472795 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.472796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.472796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.472850 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.473093 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.473094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.473094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.473212 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:15.473262 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:15.473462 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 00:05:15.473519 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:05:15.473825 21297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.464024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:34057 (local address 127.19.59.66:56379)
0812 00:05:15.464165 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:15.464200 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:15.464684 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:15.464926 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:15.464930 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:15.465286 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:15.465551 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.465558 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.466632 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.466633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.467937 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.467946 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.468483 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.468484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.468638 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.469202 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:15.469212 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:15.471050 (+ 1838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:15.472468 (+ 1418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:15.472475 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:15.472476 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:15.472721 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:15.472927 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:15.472928 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:15.472928 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:15.473028 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:15.473263 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:15.473267 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:15.473373 (+ 106us) client_negotiation.cc:769] Sending connection context
0812 00:05:15.473453 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 00:05:15.473568 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":77,"threads_started":1}
I20260812 00:05:15.474273 21425 heartbeater.cc:347] Connected to a master server at 127.19.59.126:34057
I20260812 00:05:15.474351 21425 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:15.474529 21425 heartbeater.cc:511] Master 127.19.59.126:34057 requested a full tablet report, sending...
I20260812 00:05:15.474903 21022 ts_manager.cc:194] Registered new tserver with Master: 9af2163a305844728f52971a5fb63a8d (127.19.59.66:39593)
I20260812 00:05:15.475409 21022 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:56379
I20260812 00:05:15.477070 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 21270
I20260812 00:05:15.477170 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:15.477342 19693 external_mini_cluster.cc:1428] Setting key b538e48de40a3241fa108510fcbf5dff
I20260812 00:05:15.480521 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.475286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:56211 (local address 127.19.59.126:34057)
0812 00:05:15.475319 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:15.475321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:15.475442 (+ 121us) server_negotiation.cc:407] Connection header received
0812 00:05:15.475508 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:15.475509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:15.475519 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:15.475581 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:15.475894 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.476337 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.476998 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.477236 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.477293 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.478232 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:15.478233 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:15.478233 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:15.478240 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:15.479444 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.479753 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.479754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.479754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.479805 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.480002 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.480003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.480003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.480142 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:15.480212 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:15.480366 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 00:05:15.480445 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 00:05:15.480531 21432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.475207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:34057 (local address 127.19.59.66:56211)
0812 00:05:15.475373 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:15.475383 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:15.475444 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:15.475574 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:15.475575 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:15.475753 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:15.475822 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.475824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.476421 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.476422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.476918 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.476919 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.477292 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.477293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.477372 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.477798 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:15.477803 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:15.478154 (+ 351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:15.479520 (+ 1366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:15.479521 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:15.479521 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:15.479685 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:15.479873 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:15.479873 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:15.479874 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:15.479938 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:15.480204 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:15.480205 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:15.480249 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 00:05:15.480326 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:05:15.480427 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":88,"threads_started":1}
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:05:15.500460 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:34057
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:15.578840 21435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:15.579039 21435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:15.579063 21435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:15.580109 21435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:15.580142 21435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:15.580159 21435 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:05:15.580175 21435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:05:15.581521 21435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.59.126:34057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:15.581696 21435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:15.581879 21435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:15.586685 21442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:15.586675 21443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:15.586675 21446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:15.586863 21435 server_base.cc:1034] running on GCE node
I20260812 00:05:15.587093 21435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:15.587309 21435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:15.588438 21435 hybrid_clock.cc:648] HybridClock initialized: now 1786493115588430 us; error 25 us; skew 500 ppm
Aug 12 00:05:15 dist-test-slave-6nmv krb5kdc[20970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493115, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:15.590875 21435 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:05:15.591391 21435 webserver.cc:460] Webserver started at http://127.19.59.67:41047/ using document root <none> and password file <none>
I20260812 00:05:15.591619 21435 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:15.591665 21435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:15.591831 21435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:15.592878 21435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "6c988428d87e4ce0adbceefadee657ba"
format_stamp: "Formatted at 2026-08-12 00:05:15 on dist-test-slave-6nmv"
server_key: "330b5705e7cb6db33a53ef7caa111c0b"
server_key_iv: "84fe9569e50e9842fa68be19a285c82c"
server_key_version: "encryptionkey@0"
I20260812 00:05:15.593206 21435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "6c988428d87e4ce0adbceefadee657ba"
format_stamp: "Formatted at 2026-08-12 00:05:15 on dist-test-slave-6nmv"
server_key: "330b5705e7cb6db33a53ef7caa111c0b"
server_key_iv: "84fe9569e50e9842fa68be19a285c82c"
server_key_version: "encryptionkey@0"
I20260812 00:05:15.594568 21435 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:15.595332 21454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:15.595549 21435 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:15.595640 21435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "6c988428d87e4ce0adbceefadee657ba"
format_stamp: "Formatted at 2026-08-12 00:05:15 on dist-test-slave-6nmv"
server_key: "330b5705e7cb6db33a53ef7caa111c0b"
server_key_iv: "84fe9569e50e9842fa68be19a285c82c"
server_key_version: "encryptionkey@0"
I20260812 00:05:15.595715 21435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:15.606792 21435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:15.608642 21435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:15.608777 21435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:15.609254 21435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:15.609292 21435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:15.609324 21435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:15.609349 21435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:05:15 dist-test-slave-6nmv krb5kdc[20970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493115, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:15.616247 21435 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:39735
I20260812 00:05:15.616380 21591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:39735 every 8 connection(s)
I20260812 00:05:15.616674 21435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:15.618251 21464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.609589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:34057 (local address 127.19.59.67:45999)
0812 00:05:15.609725 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:15.609754 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:15.610285 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:15.610517 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:15.610521 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:15.610751 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:15.610930 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.610934 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.611640 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.611641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.612473 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.612475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.612973 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.612974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.613143 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.613608 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:15.613620 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:15.615288 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:15.617167 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:15.617171 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:15.617172 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:15.617360 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:15.617518 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:15.617519 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:15.617519 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:15.617600 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:15.617784 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:15.617788 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:15.617936 (+ 148us) client_negotiation.cc:769] Sending connection context
0812 00:05:15.618013 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:05:15.618118 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":73,"threads_started":1}
I20260812 00:05:15.618255 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.609603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:45999 (local address 127.19.59.126:34057)
0812 00:05:15.609656 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:15.609658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:15.609865 (+ 207us) server_negotiation.cc:407] Connection header received
0812 00:05:15.610394 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:15.610395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:15.610408 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:15.610459 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:15.611017 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.611537 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.612564 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.612885 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.612951 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.615379 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:15.615381 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:15.615381 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:15.615398 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:15.617103 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.617430 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.617431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.617431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.617481 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.617644 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.617644 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.617644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.617734 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:15.617780 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:15.618130 (+ 350us) server_negotiation.cc:299] Negotiation successful
0812 00:05:15.618197 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:05:15.618757 21592 heartbeater.cc:347] Connected to a master server at 127.19.59.126:34057
I20260812 00:05:15.618836 21592 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:15.619007 21592 heartbeater.cc:511] Master 127.19.59.126:34057 requested a full tablet report, sending...
I20260812 00:05:15.619361 21022 ts_manager.cc:194] Registered new tserver with Master: 6c988428d87e4ce0adbceefadee657ba (127.19.59.67:39735)
I20260812 00:05:15.619787 21022 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:45999
I20260812 00:05:15.624725 21599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.619727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:34057 (local address 127.19.59.67:37173)
0812 00:05:15.619927 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:15.619937 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:15.620000 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:15.620133 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:15.620134 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:15.620334 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:15.620396 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.620397 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.620995 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.620996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.621481 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.621482 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.621853 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.621854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.621922 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.622260 (+ 338us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:15.622263 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:15.622542 (+ 279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:15.624028 (+ 1486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:15.624028 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:15.624028 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:15.624179 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:15.624352 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:15.624352 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:15.624352 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:15.624397 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:15.624535 (+ 138us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:15.624536 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:15.624564 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 00:05:15.624603 (+ 39us) client_negotiation.cc:240] Negotiation successful
0812 00:05:15.624665 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":151,"threads_started":1}
I20260812 00:05:15.624729 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.619764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:37173 (local address 127.19.59.126:34057)
0812 00:05:15.619798 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:15.619799 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:15.620004 (+ 205us) server_negotiation.cc:407] Connection header received
0812 00:05:15.620048 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:15.620049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:15.620059 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:15.620120 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:15.620484 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.620916 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.621544 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.621744 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.621803 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.622607 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:15.622608 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:15.622608 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:15.622614 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:15.623909 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.624251 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.624252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.624253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.624305 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.624431 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.624431 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.624431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.624504 (+ 73us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:15.624543 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:15.624620 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 00:05:15.624667 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 00:05:15.625070 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 21435
I20260812 00:05:15.625149 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:15.625352 19693 external_mini_cluster.cc:1428] Setting key 19217d2fcde147991079c556803b3621
I20260812 00:05:15.626210 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:05:15 dist-test-slave-6nmv krb5kdc[20970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493115, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:05:15 dist-test-slave-6nmv krb5kdc[20970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493115, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:15.649700 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.642662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48296 (local address 127.19.59.126:34057)
0812 00:05:15.642739 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:15.642741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:15.642752 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:05:15.642798 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:15.642799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:15.642807 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:15.642875 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:15.643546 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.644042 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.644798 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.644995 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.645062 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.647339 (+ 2277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:15.647340 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:15.647340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:15.647347 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:15.648440 (+ 1093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.648786 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.648787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.648788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.648840 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.649002 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.649003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.649003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.649108 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:15.649184 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:15.649391 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 00:05:15.649515 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 00:05:15.651566 21022 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48296:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:15.653065 21022 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:15.659372 21611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.655231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38826 (local address 127.19.59.66:39593)
0812 00:05:15.655412 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:15.655417 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:15.655427 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:15.655482 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:15.655484 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:15.655507 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:15.655612 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:15.655762 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.656612 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.658133 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.658851 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.658899 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.658964 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:15.659231 (+ 267us) server_negotiation.cc:299] Negotiation successful
0812 00:05:15.659269 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":80,"threads_started":1}
I20260812 00:05:15.659463 21608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.655108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:39735 (local address 127.0.0.1:47694)
0812 00:05:15.655497 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:15.655505 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:15.655546 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:15.655967 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:15.655968 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:15.655970 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:15.656021 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.656022 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.656943 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.656943 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.657641 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.657643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.659182 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.659183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.659260 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.659265 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:05:15.659299 (+ 34us) client_negotiation.cc:240] Negotiation successful
0812 00:05:15.659361 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"mutex_wait_us":4,"spinlock_wait_cycles":768,"thread_start_us":48,"threads_started":1}
I20260812 00:05:15.659606 21610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.655108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:39593 (local address 127.0.0.1:38826)
0812 00:05:15.655266 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:15.655304 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:15.655363 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:15.655618 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:15.655621 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:15.655623 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:15.655686 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.655688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.656688 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.656689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.658039 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.658042 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.659024 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.659024 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.659112 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.659124 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 00:05:15.659493 (+ 369us) client_negotiation.cc:240] Negotiation successful
0812 00:05:15.659539 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":68,"threads_started":1}
I20260812 00:05:15.659935 21613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.655304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47694 (local address 127.19.59.67:39735)
0812 00:05:15.655752 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:15.655756 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:15.655782 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:05:15.655821 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:15.655823 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:15.655837 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:15.655952 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:15.656116 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.656840 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.657729 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.659052 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.659666 (+ 614us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.659734 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:15.659760 (+ 26us) server_negotiation.cc:299] Negotiation successful
0812 00:05:15.659809 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":84,"threads_started":1}
I20260812 00:05:15.660396 21612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.655291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46743 (local address 127.0.0.1:47212)
0812 00:05:15.655681 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:15.655690 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:15.655738 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:15.656824 (+ 1086us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:15.656824 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:15.656827 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:15.656901 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.656902 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.658118 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.658119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.659133 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.659134 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.660150 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.660151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.660216 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.660220 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:15.660295 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:05:15.660335 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"mutex_wait_us":30,"thread_start_us":34,"threads_started":1}
I20260812 00:05:15.660305 21344 tablet_service.cc:1467] Processing CreateTablet for tablet dda48830d4da48a4a34b49cdb49008a0 (DEFAULT_TABLE table=test-table [id=ea2599cfc9bc4260ba0c4ee595744988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:15.660470 21614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.655498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47212 (local address 127.19.59.65:46743)
0812 00:05:15.655662 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:15.655667 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:15.656691 (+ 1024us) server_negotiation.cc:407] Connection header received
0812 00:05:15.656732 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:15.656734 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:15.656746 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:15.656823 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:15.656992 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.658016 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.659218 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.659934 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.660007 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.660055 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:15.660326 (+ 271us) server_negotiation.cc:299] Negotiation successful
0812 00:05:15.660367 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":100,"threads_started":1}
I20260812 00:05:15.660674 21344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dda48830d4da48a4a34b49cdb49008a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:15.660574 21511 tablet_service.cc:1467] Processing CreateTablet for tablet dda48830d4da48a4a34b49cdb49008a0 (DEFAULT_TABLE table=test-table [id=ea2599cfc9bc4260ba0c4ee595744988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:15.660892 21511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dda48830d4da48a4a34b49cdb49008a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:15.661307 21180 tablet_service.cc:1467] Processing CreateTablet for tablet dda48830d4da48a4a34b49cdb49008a0 (DEFAULT_TABLE table=test-table [id=ea2599cfc9bc4260ba0c4ee595744988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:15.661690 21180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dda48830d4da48a4a34b49cdb49008a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:15.664181 21615 tablet_bootstrap.cc:492] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba: Bootstrap starting.
I20260812 00:05:15.664486 21616 tablet_bootstrap.cc:492] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d: Bootstrap starting.
I20260812 00:05:15.664719 21617 tablet_bootstrap.cc:492] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d: Bootstrap starting.
I20260812 00:05:15.665148 21615 tablet_bootstrap.cc:654] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:15.665264 21616 tablet_bootstrap.cc:654] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:15.665354 21617 tablet_bootstrap.cc:654] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:15.665501 21615 log.cc:824] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:15.665616 21616 log.cc:824] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:15.665673 21617 log.cc:824] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:15.666324 21615 tablet_bootstrap.cc:492] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba: No bootstrap required, opened a new log
I20260812 00:05:15.666325 21617 tablet_bootstrap.cc:492] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d: No bootstrap required, opened a new log
I20260812 00:05:15.666406 21615 ts_tablet_manager.cc:1397] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:15.666396 21617 ts_tablet_manager.cc:1397] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:05:15.667908 21617 raft_consensus.cc:348] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } }
I20260812 00:05:15.668033 21617 raft_consensus.cc:374] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:15.668056 21617 raft_consensus.cc:729] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9af2163a305844728f52971a5fb63a8d, State: Initialized, Role: FOLLOWER
I20260812 00:05:15.667958 21615 raft_consensus.cc:348] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } }
I20260812 00:05:15.668108 21615 raft_consensus.cc:374] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:15.668150 21615 raft_consensus.cc:729] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c988428d87e4ce0adbceefadee657ba, State: Initialized, Role: FOLLOWER
I20260812 00:05:15.668179 21617 consensus_queue.cc:260] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } }
I20260812 00:05:15.668257 21615 consensus_queue.cc:260] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } }
I20260812 00:05:15.668450 21617 ts_tablet_manager.cc:1428] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:05:15.668497 21425 heartbeater.cc:503] Master 127.19.59.126:34057 was elected leader, sending a full tablet report...
I20260812 00:05:15.668535 21615 ts_tablet_manager.cc:1428] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:15.668642 21592 heartbeater.cc:503] Master 127.19.59.126:34057 was elected leader, sending a full tablet report...
I20260812 00:05:15.669219 21616 tablet_bootstrap.cc:492] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d: No bootstrap required, opened a new log
I20260812 00:05:15.669286 21616 ts_tablet_manager.cc:1397] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260812 00:05:15.670980 21616 raft_consensus.cc:348] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } }
I20260812 00:05:15.671134 21616 raft_consensus.cc:374] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:15.671175 21616 raft_consensus.cc:729] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db8c4054c4ff4eb6b303608661b5281d, State: Initialized, Role: FOLLOWER
I20260812 00:05:15.671310 21616 consensus_queue.cc:260] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } }
I20260812 00:05:15.671561 21616 ts_tablet_manager.cc:1428] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260812 00:05:15.671634 21260 heartbeater.cc:503] Master 127.19.59.126:34057 was elected leader, sending a full tablet report...
W20260812 00:05:15.721436 21426 tablet.cc:2369] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:05:15.761165 21621 raft_consensus.cc:482] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:15.761322 21621 raft_consensus.cc:504] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } }
I20260812 00:05:15.761704 21621 leader_election.cc:288] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c988428d87e4ce0adbceefadee657ba (127.19.59.67:39735), db8c4054c4ff4eb6b303608661b5281d (127.19.59.65:46743)
I20260812 00:05:15.765617 21613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.762003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:46289 (local address 127.19.59.67:39735)
0812 00:05:15.762053 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:15.762055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:15.762065 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:15.762156 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:15.762157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:15.762166 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:15.762213 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:15.762422 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.763195 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.764737 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.765244 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.765319 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.765329 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:15.765531 (+ 202us) server_negotiation.cc:299] Negotiation successful
0812 00:05:15.765564 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:05:15.765654 21297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.761950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:39735 (local address 127.19.59.66:46289)
0812 00:05:15.761999 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:15.762011 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:15.762060 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:15.762247 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:15.762248 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:15.762251 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:15.762332 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.762334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.763305 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.763306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.764646 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.764649 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.765336 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.765337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.765438 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.765443 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:05:15.765517 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 00:05:15.765561 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":104}
I20260812 00:05:15.766060 21537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda48830d4da48a4a34b49cdb49008a0" candidate_uuid: "9af2163a305844728f52971a5fb63a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c988428d87e4ce0adbceefadee657ba" is_pre_election: true
I20260812 00:05:15.766192 21614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.762063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:42553 (local address 127.19.59.65:46743)
0812 00:05:15.762118 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:15.762120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:15.762272 (+ 152us) server_negotiation.cc:407] Connection header received
0812 00:05:15.762306 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:15.762307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:15.762314 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:15.762357 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:15.762510 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.763232 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.764738 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.765271 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.765329 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.765336 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:15.766089 (+ 753us) server_negotiation.cc:299] Negotiation successful
0812 00:05:15.766132 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:05:15.766232 21537 raft_consensus.cc:2454] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9af2163a305844728f52971a5fb63a8d in term 0.
I20260812 00:05:15.766260 21624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.761954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46743 (local address 127.19.59.66:42553)
0812 00:05:15.762175 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:15.762184 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:15.762263 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:15.762361 (+ 98us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:15.762362 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:15.762363 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:15.762438 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.762439 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.763304 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.763306 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.764646 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.764649 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.765336 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.765337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.765913 (+ 576us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.765918 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:05:15.766067 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 00:05:15.766109 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":104,"thread_start_us":109,"threads_started":1}
I20260812 00:05:15.766471 21290 leader_election.cc:302] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c988428d87e4ce0adbceefadee657ba, 9af2163a305844728f52971a5fb63a8d; no voters:
I20260812 00:05:15.766629 21621 raft_consensus.cc:2781] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:15.766710 21621 raft_consensus.cc:482] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:15.766738 21621 raft_consensus.cc:3037] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:15.766697 21202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda48830d4da48a4a34b49cdb49008a0" candidate_uuid: "9af2163a305844728f52971a5fb63a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db8c4054c4ff4eb6b303608661b5281d" is_pre_election: true
I20260812 00:05:15.766829 21202 raft_consensus.cc:2454] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9af2163a305844728f52971a5fb63a8d in term 0.
I20260812 00:05:15.767522 21621 raft_consensus.cc:504] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } }
I20260812 00:05:15.767652 21621 leader_election.cc:288] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [CANDIDATE]: Term 1 election: Requested vote from peers 6c988428d87e4ce0adbceefadee657ba (127.19.59.67:39735), db8c4054c4ff4eb6b303608661b5281d (127.19.59.65:46743)
I20260812 00:05:15.767791 21202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda48830d4da48a4a34b49cdb49008a0" candidate_uuid: "9af2163a305844728f52971a5fb63a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db8c4054c4ff4eb6b303608661b5281d"
I20260812 00:05:15.767810 21537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda48830d4da48a4a34b49cdb49008a0" candidate_uuid: "9af2163a305844728f52971a5fb63a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c988428d87e4ce0adbceefadee657ba"
I20260812 00:05:15.767870 21537 raft_consensus.cc:3037] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:15.767870 21202 raft_consensus.cc:3037] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:15.768735 21537 raft_consensus.cc:2454] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9af2163a305844728f52971a5fb63a8d in term 1.
I20260812 00:05:15.768735 21202 raft_consensus.cc:2454] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9af2163a305844728f52971a5fb63a8d in term 1.
I20260812 00:05:15.768891 21290 leader_election.cc:302] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c988428d87e4ce0adbceefadee657ba, 9af2163a305844728f52971a5fb63a8d; no voters:
I20260812 00:05:15.768972 21621 raft_consensus.cc:2781] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:15.769104 21621 raft_consensus.cc:686] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [term 1 LEADER]: Becoming Leader. State: Replica: 9af2163a305844728f52971a5fb63a8d, State: Running, Role: LEADER
I20260812 00:05:15.769181 21621 consensus_queue.cc:237] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } }
I20260812 00:05:15.770051 21022 catalog_manager.cc:5495] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9af2163a305844728f52971a5fb63a8d (127.19.59.66). New cstate: current_term: 1 leader_uuid: "9af2163a305844728f52971a5fb63a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } health_report { overall_health: UNKNOWN } } }
I20260812 00:05:15.778342 21611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.775943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38832 (local address 127.19.59.66:39593)
0812 00:05:15.776016 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:15.776018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:15.776027 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:15.776085 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:15.776086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:15.776099 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:15.776145 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:15.776259 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.776781 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.777564 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.777754 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.777906 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.778067 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:15.778165 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:15.778225 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:15.778263 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 00:05:15.778279 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 00:05:15.779950 21202 raft_consensus.cc:1261] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d [term 1 FOLLOWER]: Refusing update from remote peer 9af2163a305844728f52971a5fb63a8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:15.779938 21537 raft_consensus.cc:1261] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba [term 1 FOLLOWER]: Refusing update from remote peer 9af2163a305844728f52971a5fb63a8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:15.780295 21621 consensus_queue.cc:1035] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:15.780966 21621 consensus_queue.cc:1035] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:15.783460 21628 mvcc.cc:205] Tried to move back new op lower bound from 7317475802232209408 to 7317475802191200256. Current Snapshot: MvccSnapshot[applied={T|T < 7317475802232209408}]
I20260812 00:05:15.783569 21631 mvcc.cc:205] Tried to move back new op lower bound from 7317475802232209408 to 7317475802191200256. Current Snapshot: MvccSnapshot[applied={T|T < 7317475802232209408}]
I20260812 00:05:15.784117 21629 mvcc.cc:205] Tried to move back new op lower bound from 7317475802232209408 to 7317475802191200256. Current Snapshot: MvccSnapshot[applied={T|T < 7317475802232209408}]
I20260812 00:05:15.786845 21022 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:15.786945 21022 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:15.787724 21022 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54: Sending DeleteTablet for 3 replicas of tablet dda48830d4da48a4a34b49cdb49008a0
I20260812 00:05:15.788031 21344 tablet_service.cc:1514] Processing DeleteTablet for tablet dda48830d4da48a4a34b49cdb49008a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:15 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:38826
I20260812 00:05:15.788174 21180 tablet_service.cc:1514] Processing DeleteTablet for tablet dda48830d4da48a4a34b49cdb49008a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:15 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:47212
I20260812 00:05:15.788292 21639 tablet_replica.cc:330] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d: stopping tablet replica
I20260812 00:05:15.788379 21640 tablet_replica.cc:330] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d: stopping tablet replica
I20260812 00:05:15.788388 21639 raft_consensus.cc:2229] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:15.788482 21640 raft_consensus.cc:2229] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:15.788563 21639 raft_consensus.cc:2258] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:15.788537 21022 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48296:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 00:05:15.788599 21640 raft_consensus.cc:2258] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 00:05:15.788662 21022 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:15.789155 21639 ts_tablet_manager.cc:1905] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:15.789214 21511 tablet_service.cc:1514] Processing DeleteTablet for tablet dda48830d4da48a4a34b49cdb49008a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:15 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:47694
I20260812 00:05:15.789397 21641 tablet_replica.cc:330] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba: stopping tablet replica
I20260812 00:05:15.789492 21641 raft_consensus.cc:2229] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:15.789629 21641 raft_consensus.cc:2258] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:15.790056 21344 tablet_service.cc:1467] Processing CreateTablet for tablet cbe75070e0e045d6a1721e09e5d38988 (DEFAULT_TABLE table=test-table [id=9c12967557764f6f8905ef43c86d278b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:15.790161 21344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbe75070e0e045d6a1721e09e5d38988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:15.791095 21639 ts_tablet_manager.cc:1918] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:15.791122 21617 tablet_bootstrap.cc:492] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d: Bootstrap starting.
I20260812 00:05:15.791218 21639 log.cc:1196] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/dda48830d4da48a4a34b49cdb49008a0
I20260812 00:05:15.791563 21639 ts_tablet_manager.cc:1939] T dda48830d4da48a4a34b49cdb49008a0 P 9af2163a305844728f52971a5fb63a8d: Deleting consensus metadata
I20260812 00:05:15.791631 21180 tablet_service.cc:1467] Processing CreateTablet for tablet cbe75070e0e045d6a1721e09e5d38988 (DEFAULT_TABLE table=test-table [id=9c12967557764f6f8905ef43c86d278b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:15.791724 21617 tablet_bootstrap.cc:654] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:15.791754 21180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbe75070e0e045d6a1721e09e5d38988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:15.792819 21616 tablet_bootstrap.cc:492] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d: Bootstrap starting.
I20260812 00:05:15.793123 21003 catalog_manager.cc:4841] TS 9af2163a305844728f52971a5fb63a8d (127.19.59.66:39593): tablet dda48830d4da48a4a34b49cdb49008a0 (table test-table [id=ea2599cfc9bc4260ba0c4ee595744988]) successfully deleted
I20260812 00:05:15.793220 21616 tablet_bootstrap.cc:654] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:15.793565 21511 tablet_service.cc:1467] Processing CreateTablet for tablet cbe75070e0e045d6a1721e09e5d38988 (DEFAULT_TABLE table=test-table [id=9c12967557764f6f8905ef43c86d278b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:15.793671 21511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbe75070e0e045d6a1721e09e5d38988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:15.793833 21616 tablet_bootstrap.cc:492] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d: No bootstrap required, opened a new log
I20260812 00:05:15.793874 21616 ts_tablet_manager.cc:1397] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:15.794003 21616 raft_consensus.cc:348] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:15.794062 21616 raft_consensus.cc:374] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:15.794080 21616 raft_consensus.cc:729] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db8c4054c4ff4eb6b303608661b5281d, State: Initialized, Role: FOLLOWER
I20260812 00:05:15.794129 21616 consensus_queue.cc:260] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:15.794215 21616 ts_tablet_manager.cc:1428] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:15.794468 21640 ts_tablet_manager.cc:1905] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:15.794871 21615 tablet_bootstrap.cc:492] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba: Bootstrap starting.
I20260812 00:05:15.795228 21641 ts_tablet_manager.cc:1905] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:15.795282 21615 tablet_bootstrap.cc:654] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:15.795837 21640 ts_tablet_manager.cc:1918] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:15.795902 21640 log.cc:1196] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/wal/wals/dda48830d4da48a4a34b49cdb49008a0
I20260812 00:05:15.795962 21615 tablet_bootstrap.cc:492] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba: No bootstrap required, opened a new log
I20260812 00:05:15.796012 21615 ts_tablet_manager.cc:1397] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:15.796144 21640 ts_tablet_manager.cc:1939] T dda48830d4da48a4a34b49cdb49008a0 P db8c4054c4ff4eb6b303608661b5281d: Deleting consensus metadata
I20260812 00:05:15.796149 21615 raft_consensus.cc:348] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:15.796213 21615 raft_consensus.cc:374] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:15.796234 21615 raft_consensus.cc:729] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c988428d87e4ce0adbceefadee657ba, State: Initialized, Role: FOLLOWER
I20260812 00:05:15.796277 21615 consensus_queue.cc:260] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:15.796350 21615 ts_tablet_manager.cc:1428] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:15.796530 21003 catalog_manager.cc:4841] TS db8c4054c4ff4eb6b303608661b5281d (127.19.59.65:46743): tablet dda48830d4da48a4a34b49cdb49008a0 (table test-table [id=ea2599cfc9bc4260ba0c4ee595744988]) successfully deleted
I20260812 00:05:15.796681 21641 ts_tablet_manager.cc:1918] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:15.796769 21641 log.cc:1196] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/dda48830d4da48a4a34b49cdb49008a0
I20260812 00:05:15.797011 21641 ts_tablet_manager.cc:1939] T dda48830d4da48a4a34b49cdb49008a0 P 6c988428d87e4ce0adbceefadee657ba: Deleting consensus metadata
I20260812 00:05:15.797343 21004 catalog_manager.cc:4841] TS 6c988428d87e4ce0adbceefadee657ba (127.19.59.67:39735): tablet dda48830d4da48a4a34b49cdb49008a0 (table test-table [id=ea2599cfc9bc4260ba0c4ee595744988]) successfully deleted
I20260812 00:05:15.797521 21617 tablet_bootstrap.cc:492] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d: No bootstrap required, opened a new log
I20260812 00:05:15.797572 21617 ts_tablet_manager.cc:1397] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260812 00:05:15.797705 21617 raft_consensus.cc:348] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:15.797755 21617 raft_consensus.cc:374] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:15.797767 21617 raft_consensus.cc:729] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9af2163a305844728f52971a5fb63a8d, State: Initialized, Role: FOLLOWER
I20260812 00:05:15.797811 21617 consensus_queue.cc:260] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:15.797914 21617 ts_tablet_manager.cc:1428] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260812 00:05:15.823773 21261 tablet.cc:2369] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:05:15.867205 21593 tablet.cc:2369] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:05:15.869241 21621 raft_consensus.cc:482] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:15.869309 21621 raft_consensus.cc:504] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:15.869467 21621 leader_election.cc:288] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers db8c4054c4ff4eb6b303608661b5281d (127.19.59.65:46743), 6c988428d87e4ce0adbceefadee657ba (127.19.59.67:39735)
I20260812 00:05:15.869711 21202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbe75070e0e045d6a1721e09e5d38988" candidate_uuid: "9af2163a305844728f52971a5fb63a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db8c4054c4ff4eb6b303608661b5281d" is_pre_election: true
I20260812 00:05:15.869701 21537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbe75070e0e045d6a1721e09e5d38988" candidate_uuid: "9af2163a305844728f52971a5fb63a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c988428d87e4ce0adbceefadee657ba" is_pre_election: true
I20260812 00:05:15.869830 21202 raft_consensus.cc:2454] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9af2163a305844728f52971a5fb63a8d in term 0.
I20260812 00:05:15.869813 21537 raft_consensus.cc:2454] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9af2163a305844728f52971a5fb63a8d in term 0.
I20260812 00:05:15.870015 21289 leader_election.cc:302] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9af2163a305844728f52971a5fb63a8d, db8c4054c4ff4eb6b303608661b5281d; no voters:
I20260812 00:05:15.870114 21621 raft_consensus.cc:2781] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:15.870158 21621 raft_consensus.cc:482] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:15.870173 21621 raft_consensus.cc:3037] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:15.870849 21621 raft_consensus.cc:504] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:15.870999 21621 leader_election.cc:288] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [CANDIDATE]: Term 1 election: Requested vote from peers db8c4054c4ff4eb6b303608661b5281d (127.19.59.65:46743), 6c988428d87e4ce0adbceefadee657ba (127.19.59.67:39735)
I20260812 00:05:15.871160 21537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbe75070e0e045d6a1721e09e5d38988" candidate_uuid: "9af2163a305844728f52971a5fb63a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c988428d87e4ce0adbceefadee657ba"
I20260812 00:05:15.871186 21202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbe75070e0e045d6a1721e09e5d38988" candidate_uuid: "9af2163a305844728f52971a5fb63a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db8c4054c4ff4eb6b303608661b5281d"
I20260812 00:05:15.871268 21537 raft_consensus.cc:3037] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:15.871294 21202 raft_consensus.cc:3037] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:15.871876 21537 raft_consensus.cc:2454] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9af2163a305844728f52971a5fb63a8d in term 1.
I20260812 00:05:15.872041 21290 leader_election.cc:302] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c988428d87e4ce0adbceefadee657ba, 9af2163a305844728f52971a5fb63a8d; no voters:
I20260812 00:05:15.872145 21621 raft_consensus.cc:2781] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:15.872191 21621 raft_consensus.cc:686] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [term 1 LEADER]: Becoming Leader. State: Replica: 9af2163a305844728f52971a5fb63a8d, State: Running, Role: LEADER
I20260812 00:05:15.872229 21202 raft_consensus.cc:2454] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9af2163a305844728f52971a5fb63a8d in term 1.
I20260812 00:05:15.872246 21621 consensus_queue.cc:237] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:15.872928 21022 catalog_manager.cc:5495] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9af2163a305844728f52971a5fb63a8d (127.19.59.66). New cstate: current_term: 1 leader_uuid: "9af2163a305844728f52971a5fb63a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } health_report { overall_health: UNKNOWN } } }
Aug 12 00:05:15 dist-test-slave-6nmv krb5kdc[20970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493115, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:15.904703 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.898434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48304 (local address 127.19.59.126:34057)
0812 00:05:15.898502 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:15.898504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:15.898587 (+ 83us) server_negotiation.cc:407] Connection header received
0812 00:05:15.898635 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:15.898636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:15.898644 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:15.898729 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:15.899143 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.899584 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.900223 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.900391 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.900441 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.902493 (+ 2052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:15.902494 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:15.902494 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:15.902512 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:15.903649 (+ 1137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.904002 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.904003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.904003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.904054 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:15.904222 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:15.904223 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:15.904223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:15.904317 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:15.904383 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:15.904521 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 00:05:15.904597 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 00:05:15.904774 21653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:15.898387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:34057 (local address 127.0.0.1:48304)
0812 00:05:15.898530 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:15.898541 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:15.898599 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:15.898750 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:15.898751 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:15.899033 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:15.899078 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.899080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.899651 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.899652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.900133 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:15.900134 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:15.900449 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:15.900449 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:15.900492 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:15.900976 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:15.900981 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:15.902397 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:15.903731 (+ 1334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:15.903739 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:15.903741 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:15.903924 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:15.904111 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:15.904112 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:15.904113 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:15.904168 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:15.904375 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:15.904382 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:15.904429 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 00:05:15.904500 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 00:05:15.904659 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":69,"thread_start_us":84,"threads_started":1}
I20260812 00:05:15.906778 21022 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:48304:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 00:05:15.907056 21022 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:15.908560 21344 tablet_service.cc:1467] Processing CreateTablet for tablet 4d6ed80763014de0ba0277f1baf08cf7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c88f4d2aa7114cba8867bc616e4a5fa7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:05:15.908541 21511 tablet_service.cc:1467] Processing CreateTablet for tablet 4d6ed80763014de0ba0277f1baf08cf7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c88f4d2aa7114cba8867bc616e4a5fa7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:05:15.908582 21180 tablet_service.cc:1467] Processing CreateTablet for tablet 4d6ed80763014de0ba0277f1baf08cf7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c88f4d2aa7114cba8867bc616e4a5fa7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:05:15.908704 21180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d6ed80763014de0ba0277f1baf08cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:15.908704 21344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d6ed80763014de0ba0277f1baf08cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:15.908706 21511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d6ed80763014de0ba0277f1baf08cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:15.910919 21616 tablet_bootstrap.cc:492] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d: Bootstrap starting.
I20260812 00:05:15.911363 21616 tablet_bootstrap.cc:654] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:15.911736 21617 tablet_bootstrap.cc:492] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d: Bootstrap starting.
I20260812 00:05:15.912050 21617 tablet_bootstrap.cc:654] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:15.912263 21615 tablet_bootstrap.cc:492] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba: Bootstrap starting.
I20260812 00:05:15.912609 21617 tablet_bootstrap.cc:492] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d: No bootstrap required, opened a new log
I20260812 00:05:15.912655 21617 ts_tablet_manager.cc:1397] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:15.912664 21615 tablet_bootstrap.cc:654] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:15.912801 21617 raft_consensus.cc:348] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:15.912868 21617 raft_consensus.cc:374] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:15.912890 21617 raft_consensus.cc:729] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9af2163a305844728f52971a5fb63a8d, State: Initialized, Role: FOLLOWER
I20260812 00:05:15.912953 21617 consensus_queue.cc:260] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:15.913061 21617 ts_tablet_manager.cc:1428] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:15.913095 21633 tablet_replica.cc:439] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } }
I20260812 00:05:15.913193 21633 tablet_replica.cc:442] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:15.913430 21615 tablet_bootstrap.cc:492] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba: No bootstrap required, opened a new log
I20260812 00:05:15.913491 21615 ts_tablet_manager.cc:1397] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:15.913621 21615 raft_consensus.cc:348] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:15.913674 21615 raft_consensus.cc:374] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:15.913686 21615 raft_consensus.cc:729] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c988428d87e4ce0adbceefadee657ba, State: Initialized, Role: FOLLOWER
I20260812 00:05:15.913731 21615 consensus_queue.cc:260] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:15.913839 21615 ts_tablet_manager.cc:1428] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:15.913913 21622 tablet_replica.cc:439] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } }
I20260812 00:05:15.914011 21622 tablet_replica.cc:442] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:15.914040 21616 tablet_bootstrap.cc:492] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d: No bootstrap required, opened a new log
I20260812 00:05:15.914080 21616 ts_tablet_manager.cc:1397] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 00:05:15.914219 21616 raft_consensus.cc:348] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:15.914285 21616 raft_consensus.cc:374] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:15.914306 21616 raft_consensus.cc:729] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db8c4054c4ff4eb6b303608661b5281d, State: Initialized, Role: FOLLOWER
I20260812 00:05:15.914341 21616 consensus_queue.cc:260] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:15.914460 21616 ts_tablet_manager.cc:1428] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:15.914515 21623 tablet_replica.cc:439] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } }
I20260812 00:05:15.914605 21623 tablet_replica.cc:442] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:16.051352 21622 raft_consensus.cc:482] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:16.051476 21622 raft_consensus.cc:504] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:16.051898 21622 leader_election.cc:288] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers db8c4054c4ff4eb6b303608661b5281d (127.19.59.65:46743), 9af2163a305844728f52971a5fb63a8d (127.19.59.66:39593)
I20260812 00:05:16.054908 21464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:16.052210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46743 (local address 127.19.59.67:59809)
0812 00:05:16.052266 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:16.052283 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:16.052343 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:16.052604 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:16.052606 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:16.052608 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:16.052677 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:16.052679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.053289 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.053290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:16.054090 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:16.054093 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.054636 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.054637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:16.054714 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:16.054717 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:16.054787 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 00:05:16.054847 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 00:05:16.054903 21614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:16.052244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:59809 (local address 127.19.59.65:46743)
0812 00:05:16.052295 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:16.052297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:16.052478 (+ 181us) server_negotiation.cc:407] Connection header received
0812 00:05:16.052515 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:16.052516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:16.052524 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:16.052598 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:16.052745 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.053213 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.054174 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.054543 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.054638 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:16.054646 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:16.054797 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 00:05:16.054833 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:05:16.055130 21202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d6ed80763014de0ba0277f1baf08cf7" candidate_uuid: "6c988428d87e4ce0adbceefadee657ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db8c4054c4ff4eb6b303608661b5281d" is_pre_election: true
I20260812 00:05:16.055222 21202 raft_consensus.cc:2454] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c988428d87e4ce0adbceefadee657ba in term 0.
I20260812 00:05:16.055398 21455 leader_election.cc:302] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c988428d87e4ce0adbceefadee657ba, db8c4054c4ff4eb6b303608661b5281d; no voters:
I20260812 00:05:16.055526 21622 raft_consensus.cc:2781] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:16.055580 21622 raft_consensus.cc:482] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:16.055612 21622 raft_consensus.cc:3037] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:16.055706 21611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:16.052395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:44901 (local address 127.19.59.66:39593)
0812 00:05:16.052457 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:16.052459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:16.052602 (+ 143us) server_negotiation.cc:407] Connection header received
0812 00:05:16.052694 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:16.052695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:16.052710 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:16.052797 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:16.052992 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.053453 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.054737 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.055293 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.055399 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:16.055409 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:16.055571 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 00:05:16.055634 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:05:16.055711 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:16.052325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:39593 (local address 127.19.59.67:44901)
0812 00:05:16.052529 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:16.052541 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:16.052630 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:16.052801 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:16.052802 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:16.052803 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:16.052915 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:16.052916 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.053536 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.053537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:16.054587 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:16.054589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.055422 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.055423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:16.055499 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:16.055503 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:16.055564 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 00:05:16.055618 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":125,"threads_started":1}
I20260812 00:05:16.055998 21366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d6ed80763014de0ba0277f1baf08cf7" candidate_uuid: "6c988428d87e4ce0adbceefadee657ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9af2163a305844728f52971a5fb63a8d" is_pre_election: true
I20260812 00:05:16.056118 21366 raft_consensus.cc:2454] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c988428d87e4ce0adbceefadee657ba in term 0.
I20260812 00:05:16.056429 21622 raft_consensus.cc:504] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:16.056535 21622 leader_election.cc:288] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [CANDIDATE]: Term 1 election: Requested vote from peers db8c4054c4ff4eb6b303608661b5281d (127.19.59.65:46743), 9af2163a305844728f52971a5fb63a8d (127.19.59.66:39593)
I20260812 00:05:16.056715 21366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d6ed80763014de0ba0277f1baf08cf7" candidate_uuid: "6c988428d87e4ce0adbceefadee657ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9af2163a305844728f52971a5fb63a8d"
I20260812 00:05:16.056730 21202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d6ed80763014de0ba0277f1baf08cf7" candidate_uuid: "6c988428d87e4ce0adbceefadee657ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db8c4054c4ff4eb6b303608661b5281d"
I20260812 00:05:16.056787 21366 raft_consensus.cc:3037] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:16.056797 21202 raft_consensus.cc:3037] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:16.057370 21202 raft_consensus.cc:2454] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c988428d87e4ce0adbceefadee657ba in term 1.
I20260812 00:05:16.057451 21366 raft_consensus.cc:2454] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c988428d87e4ce0adbceefadee657ba in term 1.
I20260812 00:05:16.057590 21455 leader_election.cc:302] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c988428d87e4ce0adbceefadee657ba, db8c4054c4ff4eb6b303608661b5281d; no voters:
I20260812 00:05:16.057729 21622 raft_consensus.cc:2781] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:16.057914 21622 raft_consensus.cc:686] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [term 1 LEADER]: Becoming Leader. State: Replica: 6c988428d87e4ce0adbceefadee657ba, State: Running, Role: LEADER
I20260812 00:05:16.057992 21622 consensus_queue.cc:237] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } }
I20260812 00:05:16.058331 21659 tablet_replica.cc:439] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba: TxnStatusTablet state changed. Reason: New leader 6c988428d87e4ce0adbceefadee657ba. Latest consensus state: current_term: 1 leader_uuid: "6c988428d87e4ce0adbceefadee657ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } }
I20260812 00:05:16.058437 21659 tablet_replica.cc:442] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:05:16.058701 21661 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 00:05:16.058858 21661 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 00:05:16.058779 21021 catalog_manager.cc:5495] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c988428d87e4ce0adbceefadee657ba (127.19.59.67). New cstate: current_term: 1 leader_uuid: "6c988428d87e4ce0adbceefadee657ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } health_report { overall_health: HEALTHY } } }
I20260812 00:05:16.093216 21613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:16.090677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47706 (local address 127.19.59.67:39735)
0812 00:05:16.090713 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:16.090714 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:16.090723 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:16.090788 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:16.090789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:16.090802 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:16.090851 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:16.090953 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.091406 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.092516 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.092687 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.092739 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:16.092942 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:16.093028 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:16.093080 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:16.093155 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 00:05:16.093170 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:05:16.093286 21653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:16.090589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:39735 (local address 127.0.0.1:47706)
0812 00:05:16.090662 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:16.090672 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:16.090718 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:16.090855 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:16.090855 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:16.090856 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:05:16.090902 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:16.090905 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.091487 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.091488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:16.092429 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:16.092432 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.092758 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.092759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:16.092828 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:16.092845 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:05:16.093086 (+ 241us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:05:16.093096 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 00:05:16.093152 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 00:05:16.093203 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 00:05:16.094336 21202 raft_consensus.cc:1261] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d [term 1 FOLLOWER]: Refusing update from remote peer 6c988428d87e4ce0adbceefadee657ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:16.094404 21366 raft_consensus.cc:1261] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d [term 1 FOLLOWER]: Refusing update from remote peer 6c988428d87e4ce0adbceefadee657ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:16.094645 21622 consensus_queue.cc:1035] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:16.094770 21659 consensus_queue.cc:1035] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:16.095340 21623 tablet_replica.cc:439] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d: TxnStatusTablet state changed. Reason: New leader 6c988428d87e4ce0adbceefadee657ba. Latest consensus state: current_term: 1 leader_uuid: "6c988428d87e4ce0adbceefadee657ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } }
I20260812 00:05:16.095422 21623 tablet_replica.cc:442] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:16.095451 21633 tablet_replica.cc:439] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d: TxnStatusTablet state changed. Reason: New leader 6c988428d87e4ce0adbceefadee657ba. Latest consensus state: current_term: 1 leader_uuid: "6c988428d87e4ce0adbceefadee657ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } }
I20260812 00:05:16.095543 21633 tablet_replica.cc:442] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:16.096155 21659 tablet_replica.cc:439] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6c988428d87e4ce0adbceefadee657ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } }
I20260812 00:05:16.096226 21659 tablet_replica.cc:442] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:05:16.096352 21633 tablet_replica.cc:439] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6c988428d87e4ce0adbceefadee657ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } }
I20260812 00:05:16.096441 21633 tablet_replica.cc:442] T 4d6ed80763014de0ba0277f1baf08cf7 P 9af2163a305844728f52971a5fb63a8d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:16.096565 21622 tablet_replica.cc:439] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6c988428d87e4ce0adbceefadee657ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } }
I20260812 00:05:16.096671 21622 tablet_replica.cc:442] T 4d6ed80763014de0ba0277f1baf08cf7 P 6c988428d87e4ce0adbceefadee657ba: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:05:16.097440 21623 tablet_replica.cc:439] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6c988428d87e4ce0adbceefadee657ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 } } peers { permanent_uuid: "9af2163a305844728f52971a5fb63a8d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39593 } } peers { permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 } } }
I20260812 00:05:16.097532 21623 tablet_replica.cc:442] T 4d6ed80763014de0ba0277f1baf08cf7 P db8c4054c4ff4eb6b303608661b5281d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:16.102723 21613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:16.100582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:50151 (local address 127.19.59.67:39735)
0812 00:05:16.100633 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:16.100634 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:16.100657 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:05:16.100721 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:16.100722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:16.100730 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:16.100776 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:16.100867 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.101235 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.102071 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.102265 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.102344 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:16.102514 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:16.102558 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:16.102612 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:16.102656 (+ 44us) server_negotiation.cc:299] Negotiation successful
0812 00:05:16.102671 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:05:16.102777 21672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:16.100495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:39735 (local address 127.19.59.66:50151)
0812 00:05:16.100593 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:16.100612 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:16.100672 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:16.100779 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:16.100779 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:16.100781 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:05:16.100821 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:16.100822 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.101341 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.101342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:16.101993 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:16.101995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.102349 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.102350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:16.102406 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:16.102422 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:05:16.102614 (+ 192us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:05:16.102616 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:05:16.102655 (+ 39us) client_negotiation.cc:240] Negotiation successful
0812 00:05:16.102697 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65,"thread_start_us":38,"threads_started":1}
I20260812 00:05:16.104506 21202 raft_consensus.cc:1261] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d [term 1 FOLLOWER]: Refusing update from remote peer 9af2163a305844728f52971a5fb63a8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:16.104598 21537 raft_consensus.cc:1261] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba [term 1 FOLLOWER]: Refusing update from remote peer 9af2163a305844728f52971a5fb63a8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:16.104763 21621 consensus_queue.cc:1035] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c988428d87e4ce0adbceefadee657ba" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 39735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:16.104852 21633 consensus_queue.cc:1035] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "db8c4054c4ff4eb6b303608661b5281d" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:16.112481 21599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:16.109922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:39593 (local address 127.19.59.67:48471)
0812 00:05:16.109985 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:16.109995 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:16.110050 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:16.110203 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:16.110204 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:16.110205 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:05:16.110239 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:16.110240 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.110767 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.110767 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:16.111622 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:16.111625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.112000 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.112001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:16.112058 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:16.112070 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:05:16.112312 (+ 242us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:05:16.112314 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:05:16.112356 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 00:05:16.112401 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 00:05:16.112746 21611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:16.110063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:48471 (local address 127.19.59.66:39593)
0812 00:05:16.110098 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:16.110100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:16.110108 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:16.110128 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:16.110129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:16.110138 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:16.110195 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:16.110289 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.110709 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.111699 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.111928 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.111983 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:16.112185 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:16.112236 (+ 51us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:16.112285 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:16.112678 (+ 393us) server_negotiation.cc:299] Negotiation successful
0812 00:05:16.112704 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:05:16.118597 21021 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:16.118701 21021 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:16.119306 21021 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 309a02a2c1774aa0be0ff13725383a54: Sending DeleteTablet for 3 replicas of tablet cbe75070e0e045d6a1721e09e5d38988
I20260812 00:05:16.119555 21511 tablet_service.cc:1514] Processing DeleteTablet for tablet cbe75070e0e045d6a1721e09e5d38988 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:16 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:47694
I20260812 00:05:16.119620 21180 tablet_service.cc:1514] Processing DeleteTablet for tablet cbe75070e0e045d6a1721e09e5d38988 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:16 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:47212
I20260812 00:05:16.119673 21344 tablet_service.cc:1514] Processing DeleteTablet for tablet cbe75070e0e045d6a1721e09e5d38988 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:16 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:38826
I20260812 00:05:16.119729 21641 tablet_replica.cc:330] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba: stopping tablet replica
I20260812 00:05:16.119751 21639 tablet_replica.cc:330] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d: stopping tablet replica
I20260812 00:05:16.119774 21641 raft_consensus.cc:2229] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:16.119797 21639 raft_consensus.cc:2229] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:16.119807 21641 raft_consensus.cc:2258] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:16.119843 21639 raft_consensus.cc:2258] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:16.119874 21640 tablet_replica.cc:330] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d: stopping tablet replica
I20260812 00:05:16.119922 21640 raft_consensus.cc:2229] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:16.119956 21640 raft_consensus.cc:2258] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:16.120131 21641 ts_tablet_manager.cc:1905] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:16.120254 21640 ts_tablet_manager.cc:1905] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:16.120628 21639 ts_tablet_manager.cc:1905] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:16.121713 21641 ts_tablet_manager.cc:1918] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:05:16.121775 21641 log.cc:1196] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/cbe75070e0e045d6a1721e09e5d38988
I20260812 00:05:16.122004 21641 ts_tablet_manager.cc:1939] T cbe75070e0e045d6a1721e09e5d38988 P 6c988428d87e4ce0adbceefadee657ba: Deleting consensus metadata
I20260812 00:05:16.122347 21004 catalog_manager.cc:4841] TS 6c988428d87e4ce0adbceefadee657ba (127.19.59.67:39735): tablet cbe75070e0e045d6a1721e09e5d38988 (table test-table [id=9c12967557764f6f8905ef43c86d278b]) successfully deleted
I20260812 00:05:16.122424 21639 ts_tablet_manager.cc:1918] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:05:16.122511 21639 log.cc:1196] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/cbe75070e0e045d6a1721e09e5d38988
I20260812 00:05:16.122745 21639 ts_tablet_manager.cc:1939] T cbe75070e0e045d6a1721e09e5d38988 P 9af2163a305844728f52971a5fb63a8d: Deleting consensus metadata
I20260812 00:05:16.123055 21003 catalog_manager.cc:4841] TS 9af2163a305844728f52971a5fb63a8d (127.19.59.66:39593): tablet cbe75070e0e045d6a1721e09e5d38988 (table test-table [id=9c12967557764f6f8905ef43c86d278b]) successfully deleted
I20260812 00:05:16.123059 21640 ts_tablet_manager.cc:1918] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:05:16.123113 21640 log.cc:1196] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786493109864389-19693-0/minicluster-data/ts-0/wal/wals/cbe75070e0e045d6a1721e09e5d38988
I20260812 00:05:16.123348 21640 ts_tablet_manager.cc:1939] T cbe75070e0e045d6a1721e09e5d38988 P db8c4054c4ff4eb6b303608661b5281d: Deleting consensus metadata
I20260812 00:05:16.123638 21003 catalog_manager.cc:4841] TS db8c4054c4ff4eb6b303608661b5281d (127.19.59.65:46743): tablet cbe75070e0e045d6a1721e09e5d38988 (table test-table [id=9c12967557764f6f8905ef43c86d278b]) successfully deleted
Aug 12 00:05:16 dist-test-slave-6nmv krb5kdc[20970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493115, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.59.65@KRBTEST.COM
I20260812 00:05:16.132404 21614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:16.123831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47220 (local address 127.19.59.65:46743)
0812 00:05:16.123868 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:16.123869 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:16.124007 (+ 138us) server_negotiation.cc:407] Connection header received
0812 00:05:16.124075 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:16.124076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:16.124087 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:16.124151 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:16.124737 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.125402 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.126127 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.126410 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.126489 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:16.129388 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:16.129396 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:16.129396 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:16.129403 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:16.131163 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:16.131565 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:16.131568 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:16.131569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:16.131667 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:16.131867 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:16.131868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:16.131869 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:16.132037 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:16.132184 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:16.132238 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 00:05:16.132319 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
W20260812 00:05:16.132804 21252 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47220
I20260812 00:05:16.139699 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:16.133681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48318 (local address 127.19.59.126:34057)
0812 00:05:16.133726 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:16.133727 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:16.133740 (+ 13us) server_negotiation.cc:407] Connection header received
0812 00:05:16.133867 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:16.133867 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:16.133878 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:16.133935 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:16.134522 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.134951 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.135873 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:16.136046 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:16.136100 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:16.137333 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:16.137334 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:16.137334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:16.137340 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:16.138708 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:16.139063 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:16.139064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:16.139064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:16.139110 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:16.139298 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:16.139298 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:16.139299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:16.139385 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:16.139443 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:16.139592 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 00:05:16.139647 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 00:05:16.139886 21021 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48318
I20260812 00:05:16.140522 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 21104
I20260812 00:05:16.156838 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 21270
I20260812 00:05:16.165120 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 21435
I20260812 00:05:16.173368 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 20983
2026-08-12T00:05:16Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2344 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:16 dist-test-slave-6nmv krb5kdc[21689](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:16 dist-test-slave-6nmv krb5kdc[21689](info): set up 2 sockets
Aug 12 00:05:16 dist-test-slave-6nmv krb5kdc[21689](info): commencing operation
krb5kdc: starting...
W20260812 00:05:17.240949 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:05:17 dist-test-slave-6nmv krb5kdc[21689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:05:17.352535 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:45959
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:45959
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:17.429621 21703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:17.429841 21703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:17.429893 21703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:17.430889 21703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:17.430958 21703 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 00:05:17.430982 21703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:17.431012 21703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:17.431038 21703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:17.431066 21703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:17.432480 21703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:45959
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:45959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:17.432747 21703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:17.432964 21703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:17.437295 21709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:17.437332 21708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:17.437448 21703 server_base.cc:1034] running on GCE node
W20260812 00:05:17.437309 21712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:17.437719 21703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:17.437997 21703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:17.439154 21703 hybrid_clock.cc:648] HybridClock initialized: now 1786493117439140 us; error 30 us; skew 500 ppm
Aug 12 00:05:17 dist-test-slave-6nmv krb5kdc[21689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493117, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:17.441596 21703 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:05:17.442057 21703 webserver.cc:460] Webserver started at http://127.19.59.126:41147/ using document root <none> and password file <none>
I20260812 00:05:17.442265 21703 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:17.442327 21703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:17.442471 21703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:17.443384 21703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "1c4937835eb149eb9421af015af560ec"
format_stamp: "Formatted at 2026-08-12 00:05:17 on dist-test-slave-6nmv"
server_key: "e9f3bcc346faa8b0d4833c11c4e9a31b"
server_key_iv: "d3dfc122c4d4a18c2c7374c648530650"
server_key_version: "encryptionkey@0"
I20260812 00:05:17.443708 21703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "1c4937835eb149eb9421af015af560ec"
format_stamp: "Formatted at 2026-08-12 00:05:17 on dist-test-slave-6nmv"
server_key: "e9f3bcc346faa8b0d4833c11c4e9a31b"
server_key_iv: "d3dfc122c4d4a18c2c7374c648530650"
server_key_version: "encryptionkey@0"
I20260812 00:05:17.445031 21703 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:17.445732 21719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:17.445928 21703 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:17.446034 21703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "1c4937835eb149eb9421af015af560ec"
format_stamp: "Formatted at 2026-08-12 00:05:17 on dist-test-slave-6nmv"
server_key: "e9f3bcc346faa8b0d4833c11c4e9a31b"
server_key_iv: "d3dfc122c4d4a18c2c7374c648530650"
server_key_version: "encryptionkey@0"
I20260812 00:05:17.446110 21703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:17.456617 21703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:17.458384 21703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:17.458492 21703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:17.462774 21703 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:45959
I20260812 00:05:17.462870 21794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:45959 every 8 connection(s)
I20260812 00:05:17.463112 21703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:17.463716 21795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:17.465662 21795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec: Bootstrap starting.
I20260812 00:05:17.466223 21795 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:17.466508 21795 log.cc:824] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:17.467114 21795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec: No bootstrap required, opened a new log
I20260812 00:05:17.467232 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 21703
I20260812 00:05:17.467327 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:17.467492 19693 external_mini_cluster.cc:1428] Setting key c3d996e96cd0829afea9163beec38931
I20260812 00:05:17.469944 21795 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4937835eb149eb9421af015af560ec" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45959 } }
I20260812 00:05:17.470148 21795 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:17.470199 21795 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c4937835eb149eb9421af015af560ec, State: Initialized, Role: FOLLOWER
I20260812 00:05:17.470331 21795 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4937835eb149eb9421af015af560ec" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45959 } }
I20260812 00:05:17.470408 21795 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:17.470459 21795 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:17.470518 21795 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:17.471122 21795 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4937835eb149eb9421af015af560ec" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45959 } }
I20260812 00:05:17.471223 21795 leader_election.cc:302] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c4937835eb149eb9421af015af560ec; no voters:
I20260812 00:05:17.471379 21795 leader_election.cc:288] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:17.471490 21800 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:17.471627 21795 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:17.471683 21800 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [term 1 LEADER]: Becoming Leader. State: Replica: 1c4937835eb149eb9421af015af560ec, State: Running, Role: LEADER
I20260812 00:05:17.471871 21800 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4937835eb149eb9421af015af560ec" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45959 } }
I20260812 00:05:17.472335 21801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c4937835eb149eb9421af015af560ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4937835eb149eb9421af015af560ec" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45959 } } }
I20260812 00:05:17.472417 21801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:17.472652 21802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c4937835eb149eb9421af015af560ec. Latest consensus state: current_term: 1 leader_uuid: "1c4937835eb149eb9421af015af560ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4937835eb149eb9421af015af560ec" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45959 } } }
I20260812 00:05:17.472719 21802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:17.472966 21810 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:17.473556 21810 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:17.475073 21810 catalog_manager.cc:1347] Generated new cluster ID: 12639feb421244c98b07ccb997872747
I20260812 00:05:17.475127 21810 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:05:17 dist-test-slave-6nmv krb5kdc[21689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:17.479715 21799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.467994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45576 (local address 127.19.59.126:45959)
0812 00:05:17.468322 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:17.468356 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:17.468388 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:05:17.469892 (+ 1504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:17.469901 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:17.469957 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:17.470086 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:17.470793 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.472129 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.473280 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.473661 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.473768 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.476340 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:17.476343 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:17.476344 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:17.476354 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:17.478392 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.478725 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.478728 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.478733 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.478805 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.478993 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.478994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.478994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.479194 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:17.479346 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:17.479420 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 00:05:17.479545 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":98,"threads_started":1}
I20260812 00:05:17.497328 21810 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:17.498001 21810 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:17.504029 21810 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec: Generated new TSK 0
I20260812 00:05:17.504180 21810 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:05:17.533035 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:45959
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:17.607622 21824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:17.607789 21824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:17.607810 21824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:17.608808 21824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:17.608845 21824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:17.608865 21824 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 00:05:17.608906 21824 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:05:17.608935 21824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:05:17.610246 21824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.59.126:45959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:17.610461 21824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:17.610661 21824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:17.615106 21832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:17.615127 21835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:17.615198 21824 server_base.cc:1034] running on GCE node
W20260812 00:05:17.615131 21833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:17.615495 21824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:17.615715 21824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:17.616868 21824 hybrid_clock.cc:648] HybridClock initialized: now 1786493117616859 us; error 32 us; skew 500 ppm
Aug 12 00:05:17 dist-test-slave-6nmv krb5kdc[21689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493117, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:17.619102 21824 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:05:17.619480 21824 webserver.cc:460] Webserver started at http://127.19.59.65:45889/ using document root <none> and password file <none>
I20260812 00:05:17.619665 21824 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:17.619721 21824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:17.619843 21824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:17.620719 21824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "062953e2d566492ea8645c1c370122fb"
format_stamp: "Formatted at 2026-08-12 00:05:17 on dist-test-slave-6nmv"
server_key: "f30d85c96a2e06ef95e93e4c38458f1c"
server_key_iv: "96e70759a1fc5e5db0f50244a49a0aaa"
server_key_version: "encryptionkey@0"
I20260812 00:05:17.621047 21824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "062953e2d566492ea8645c1c370122fb"
format_stamp: "Formatted at 2026-08-12 00:05:17 on dist-test-slave-6nmv"
server_key: "f30d85c96a2e06ef95e93e4c38458f1c"
server_key_iv: "96e70759a1fc5e5db0f50244a49a0aaa"
server_key_version: "encryptionkey@0"
I20260812 00:05:17.622380 21824 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 00:05:17.623023 21844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:17.623178 21824 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:17.623265 21824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "062953e2d566492ea8645c1c370122fb"
format_stamp: "Formatted at 2026-08-12 00:05:17 on dist-test-slave-6nmv"
server_key: "f30d85c96a2e06ef95e93e4c38458f1c"
server_key_iv: "96e70759a1fc5e5db0f50244a49a0aaa"
server_key_version: "encryptionkey@0"
I20260812 00:05:17.623328 21824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:17.631983 21824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:17.633549 21824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:17.633680 21824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:17.634249 21824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:17.634303 21824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:17.634384 21824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:17.634413 21824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:05:17 dist-test-slave-6nmv krb5kdc[21689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493117, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:17.640977 21824 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:46727
I20260812 00:05:17.641024 21980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:46727 every 8 connection(s)
I20260812 00:05:17.641368 21824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:05:17.643529 21799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.634629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:48745 (local address 127.19.59.126:45959)
0812 00:05:17.634686 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:17.634688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:17.634833 (+ 145us) server_negotiation.cc:407] Connection header received
0812 00:05:17.635240 (+ 407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:17.635242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:17.635255 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:17.635332 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:17.635929 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.636703 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.638104 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.638422 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.638485 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.640995 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:17.640996 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:17.640997 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:17.641005 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:17.642504 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.642861 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.642861 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.642862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.642908 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.643093 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.643093 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.643094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.643183 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:17.643228 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:17.643414 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 00:05:17.643471 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:05:17.643677 21853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.634594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:45959 (local address 127.19.59.65:48745)
0812 00:05:17.634726 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:17.634759 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:17.635156 (+ 397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:17.635373 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:17.635376 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:17.635606 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:17.635841 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.635846 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.636795 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.636796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.638008 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.638012 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.638540 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.638540 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.638693 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.639214 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:17.639220 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:17.640887 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:17.642585 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:17.642590 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:17.642591 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:17.642803 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:17.642958 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:17.642958 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:17.642958 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:17.643046 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:17.643229 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:17.643233 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:17.643325 (+ 92us) client_negotiation.cc:769] Sending connection context
0812 00:05:17.643405 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 00:05:17.643506 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":74,"threads_started":1}
I20260812 00:05:17.644085 21981 heartbeater.cc:347] Connected to a master server at 127.19.59.126:45959
I20260812 00:05:17.644160 21981 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:17.644323 21981 heartbeater.cc:511] Master 127.19.59.126:45959 requested a full tablet report, sending...
I20260812 00:05:17.644802 21737 ts_manager.cc:194] Registered new tserver with Master: 062953e2d566492ea8645c1c370122fb (127.19.59.65:46727)
I20260812 00:05:17.645599 21737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:48745
I20260812 00:05:17.647338 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 21824
I20260812 00:05:17.647432 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:17.647608 19693 external_mini_cluster.cc:1428] Setting key d927afe340042cc5bfc31466126fa536
I20260812 00:05:17.650342 21799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.645045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:47659 (local address 127.19.59.126:45959)
0812 00:05:17.645078 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:17.645080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:17.645163 (+ 83us) server_negotiation.cc:407] Connection header received
0812 00:05:17.645214 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:17.645214 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:17.645222 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:17.645271 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:17.645558 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.646105 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.646747 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.646889 (+ 142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.646932 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.647769 (+ 837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:17.647770 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:17.647770 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:17.647777 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:17.649021 (+ 1244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.649396 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.649397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.649397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.649458 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.649629 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.649630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.649630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.649757 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:17.649839 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:17.650142 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 00:05:17.650225 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:05:17.650389 21987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.644993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:45959 (local address 127.19.59.65:47659)
0812 00:05:17.645105 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:17.645113 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:17.645166 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:17.645282 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:17.645282 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:17.645462 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:17.645503 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.645505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.646189 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.646190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.646689 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.646691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.646934 (+ 243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.646934 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.646976 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.647370 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:17.647374 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:17.647705 (+ 331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:17.649095 (+ 1390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:17.649096 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:17.649097 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:17.649296 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:17.649514 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:17.649515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:17.649515 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:17.649562 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:17.649990 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:17.649991 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:17.650030 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 00:05:17.650105 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:05:17.650207 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":69,"threads_started":1}
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:05:17.672950 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:45959
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:17.749660 21990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:17.749863 21990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:17.749888 21990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:17.750984 21990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:17.751024 21990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:17.751061 21990 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 00:05:17.751085 21990 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:05:17.751113 21990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:05:17.752544 21990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.59.126:45959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:17.752784 21990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:17.752996 21990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:17.757648 21998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:17.757673 21996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:17.757797 21995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:17.757838 21990 server_base.cc:1034] running on GCE node
I20260812 00:05:17.758123 21990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:17.758389 21990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:17.759538 21990 hybrid_clock.cc:648] HybridClock initialized: now 1786493117759528 us; error 23 us; skew 500 ppm
Aug 12 00:05:17 dist-test-slave-6nmv krb5kdc[21689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493117, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:17.761864 21990 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:05:17.762313 21990 webserver.cc:460] Webserver started at http://127.19.59.66:39499/ using document root <none> and password file <none>
I20260812 00:05:17.762540 21990 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:17.762603 21990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:17.762753 21990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:17.763630 21990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "307f6b1c467a4d33b13d093da040aa47"
format_stamp: "Formatted at 2026-08-12 00:05:17 on dist-test-slave-6nmv"
server_key: "f64f188e3ccf9b07d476ca4ddbfb8f69"
server_key_iv: "dc1d035c020745fe98b5ffa98457087f"
server_key_version: "encryptionkey@0"
I20260812 00:05:17.763962 21990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "307f6b1c467a4d33b13d093da040aa47"
format_stamp: "Formatted at 2026-08-12 00:05:17 on dist-test-slave-6nmv"
server_key: "f64f188e3ccf9b07d476ca4ddbfb8f69"
server_key_iv: "dc1d035c020745fe98b5ffa98457087f"
server_key_version: "encryptionkey@0"
I20260812 00:05:17.765149 21990 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:05:17.765784 22007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:17.766021 21990 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:17.766106 21990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "307f6b1c467a4d33b13d093da040aa47"
format_stamp: "Formatted at 2026-08-12 00:05:17 on dist-test-slave-6nmv"
server_key: "f64f188e3ccf9b07d476ca4ddbfb8f69"
server_key_iv: "dc1d035c020745fe98b5ffa98457087f"
server_key_version: "encryptionkey@0"
I20260812 00:05:17.766181 21990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:17.783476 21990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:17.785182 21990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:17.785331 21990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:17.785910 21990 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:17.785984 21990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:17.786013 21990 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:17.786031 21990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:05:17 dist-test-slave-6nmv krb5kdc[21689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493117, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:17.793040 21990 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:42719
I20260812 00:05:17.793123 22134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:42719 every 8 connection(s)
I20260812 00:05:17.793499 21990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:17.795089 21799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.786262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:36953 (local address 127.19.59.126:45959)
0812 00:05:17.786325 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:17.786328 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:17.786623 (+ 295us) server_negotiation.cc:407] Connection header received
0812 00:05:17.787204 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:17.787205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:17.787215 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:17.787259 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:17.788064 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.788593 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.790080 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.790309 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.790380 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.792487 (+ 2107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:17.792489 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:17.792489 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:17.792497 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:17.794087 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.794417 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.794417 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.794418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.794476 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.794637 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.794637 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.794638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.794728 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:17.794772 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:17.794968 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 00:05:17.795031 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:05:17.795214 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.786257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:45959 (local address 127.19.59.66:36953)
0812 00:05:17.786437 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:17.786492 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:17.787097 (+ 605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:17.787337 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:17.787342 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:17.787697 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:17.787963 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.787969 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.788662 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.788663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.789979 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.789982 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.790432 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.790433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.790526 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.790948 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:17.790961 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:17.792382 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:17.794147 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:17.794151 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:17.794152 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:17.794344 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:17.794515 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:17.794516 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:17.794516 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:17.794593 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:17.794763 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:17.794765 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:17.794852 (+ 87us) client_negotiation.cc:769] Sending connection context
0812 00:05:17.794936 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 00:05:17.795038 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":94,"threads_started":1}
I20260812 00:05:17.795629 22135 heartbeater.cc:347] Connected to a master server at 127.19.59.126:45959
I20260812 00:05:17.795703 22135 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:17.795861 22135 heartbeater.cc:511] Master 127.19.59.126:45959 requested a full tablet report, sending...
I20260812 00:05:17.796213 21738 ts_manager.cc:194] Registered new tserver with Master: 307f6b1c467a4d33b13d093da040aa47 (127.19.59.66:42719)
I20260812 00:05:17.796715 21738 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:36953
I20260812 00:05:17.797349 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 21990
I20260812 00:05:17.797432 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:17.797631 19693 external_mini_cluster.cc:1428] Setting key dc6532a416e5b12dfe5ce067f1d1a543
I20260812 00:05:17.802299 21799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.796636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:53243 (local address 127.19.59.126:45959)
0812 00:05:17.796673 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:17.796674 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:17.796730 (+ 56us) server_negotiation.cc:407] Connection header received
0812 00:05:17.796791 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:17.796792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:17.796799 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:17.796870 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:17.797193 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.797651 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.798533 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.798757 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.798815 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.799645 (+ 830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:17.799646 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:17.799647 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:17.799652 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:17.801143 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.801542 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.801543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.801543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.801592 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.801781 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.801781 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.801782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.801963 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:17.802019 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:17.802183 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 00:05:17.802243 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:05:17.802430 22142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.796543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:45959 (local address 127.19.59.66:53243)
0812 00:05:17.796671 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:17.796682 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:17.796740 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:17.796898 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:17.796898 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:17.797077 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:17.797126 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.797127 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.797742 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.797743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.798455 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.798458 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.798829 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.798830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.798917 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.799235 (+ 318us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:17.799239 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:17.799566 (+ 327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:17.801220 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:17.801221 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:17.801221 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:17.801475 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:17.801652 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:17.801652 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:17.801653 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:17.801722 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:17.802030 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:17.802031 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:17.802079 (+ 48us) client_negotiation.cc:769] Sending connection context
0812 00:05:17.802157 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 00:05:17.802276 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:05:17.820264 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:45959
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:17.895581 22145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:17.895783 22145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:17.895841 22145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:17.897007 22145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:17.897061 22145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:17.897096 22145 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 00:05:17.897141 22145 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:05:17.897171 22145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:05:17.898598 22145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.59.126:45959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:17.898844 22145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:17.899057 22145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:17.903868 22151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:17.903854 22154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:17.903873 22150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:17.904150 22145 server_base.cc:1034] running on GCE node
I20260812 00:05:17.904358 22145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:17.904599 22145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:17.905752 22145 hybrid_clock.cc:648] HybridClock initialized: now 1786493117905749 us; error 38 us; skew 500 ppm
Aug 12 00:05:17 dist-test-slave-6nmv krb5kdc[21689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493117, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:17.908118 22145 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:05:17.908555 22145 webserver.cc:460] Webserver started at http://127.19.59.67:40053/ using document root <none> and password file <none>
I20260812 00:05:17.908797 22145 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:17.908861 22145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:17.909029 22145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:17.910036 22145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b"
format_stamp: "Formatted at 2026-08-12 00:05:17 on dist-test-slave-6nmv"
server_key: "3a1fc5e71a06d65409114962e9e40d2b"
server_key_iv: "994e00902bda96235ec755b81e46b025"
server_key_version: "encryptionkey@0"
I20260812 00:05:17.910364 22145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b"
format_stamp: "Formatted at 2026-08-12 00:05:17 on dist-test-slave-6nmv"
server_key: "3a1fc5e71a06d65409114962e9e40d2b"
server_key_iv: "994e00902bda96235ec755b81e46b025"
server_key_version: "encryptionkey@0"
I20260812 00:05:17.911648 22145 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:17.912312 22163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:17.912484 22145 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:17.912569 22145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b"
format_stamp: "Formatted at 2026-08-12 00:05:17 on dist-test-slave-6nmv"
server_key: "3a1fc5e71a06d65409114962e9e40d2b"
server_key_iv: "994e00902bda96235ec755b81e46b025"
server_key_version: "encryptionkey@0"
I20260812 00:05:17.912642 22145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:17.924381 22145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:17.926424 22145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:17.926565 22145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:17.927012 22145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:17.927065 22145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:17.927102 22145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:17.927126 22145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:05:17 dist-test-slave-6nmv krb5kdc[21689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493117, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:17.933678 22145 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:44491
I20260812 00:05:17.933776 22292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:44491 every 8 connection(s)
I20260812 00:05:17.934104 22145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:17.934465 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 22145
I20260812 00:05:17.934576 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:17.934773 19693 external_mini_cluster.cc:1428] Setting key 1035efcd302cfc7e233b6348c3ce2701
I20260812 00:05:17.936565 21799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.927434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:49213 (local address 127.19.59.126:45959)
0812 00:05:17.927473 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:17.927475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:17.927646 (+ 171us) server_negotiation.cc:407] Connection header received
0812 00:05:17.928075 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:17.928076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:17.928090 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:17.928135 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:17.928692 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.929452 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.930963 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.931193 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.931284 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.933600 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:17.933601 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:17.933601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:17.933608 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:17.935427 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.935831 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.935832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.935832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.935889 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.936089 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.936089 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.936090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.936211 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:17.936256 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:17.936429 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 00:05:17.936498 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:05:17.936697 22173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.927407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:45959 (local address 127.19.59.67:49213)
0812 00:05:17.927536 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:17.927576 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:17.927971 (+ 395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:17.928188 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:17.928192 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:17.928434 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:17.928602 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.928606 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.929564 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.929565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.930873 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.930876 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.931312 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.931313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.931428 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.931961 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:17.931970 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:17.933501 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:17.935501 (+ 2000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:17.935506 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:17.935508 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:17.935772 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:17.935943 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:17.935944 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:17.935944 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:17.936046 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:17.936247 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:17.936249 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:17.936345 (+ 96us) client_negotiation.cc:769] Sending connection context
0812 00:05:17.936407 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 00:05:17.936535 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":78,"threads_started":1}
I20260812 00:05:17.937080 22293 heartbeater.cc:347] Connected to a master server at 127.19.59.126:45959
I20260812 00:05:17.937152 22293 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:17.937305 22293 heartbeater.cc:511] Master 127.19.59.126:45959 requested a full tablet report, sending...
I20260812 00:05:17.937655 21737 ts_manager.cc:194] Registered new tserver with Master: 4e04934d4d9b4ad1b36a9123f23dfa1b (127.19.59.67:44491)
I20260812 00:05:17.938054 21737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:49213
I20260812 00:05:17.942422 21799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.938038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:46383 (local address 127.19.59.126:45959)
0812 00:05:17.938070 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:17.938072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:17.938186 (+ 114us) server_negotiation.cc:407] Connection header received
0812 00:05:17.938238 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:17.938238 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:17.938246 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:17.938289 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:17.938580 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.939000 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.939576 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.939762 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.939805 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.940544 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:17.940544 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:17.940544 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:17.940549 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:17.941587 (+ 1038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.941905 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.941906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.941906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.941973 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.942117 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.942117 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.942117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.942195 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:17.942238 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:17.942317 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 00:05:17.942368 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:05:17.942436 22300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.937996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:45959 (local address 127.19.59.67:46383)
0812 00:05:17.938131 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:17.938141 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:17.938196 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:17.938304 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:17.938305 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:17.938461 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:17.938511 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.938512 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.939089 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.939090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.939518 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.939519 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.939815 (+ 296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.939816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.939865 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.940234 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:17.940239 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:17.940484 (+ 245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:17.941654 (+ 1170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:17.941654 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:17.941655 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:17.941845 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:17.942027 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:17.942028 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:17.942028 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:17.942079 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:17.942230 (+ 151us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:17.942230 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:17.942260 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 00:05:17.942304 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:05:17.942372 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":72,"threads_started":1}
I20260812 00:05:17.946316 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:05:17 dist-test-slave-6nmv krb5kdc[21689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:05:17 dist-test-slave-6nmv krb5kdc[21689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:17.966977 21799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.961306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45582 (local address 127.19.59.126:45959)
0812 00:05:17.961354 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:17.961356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:17.961365 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:17.961480 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:17.961481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:17.961491 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:17.961555 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:17.962162 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.962636 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.963269 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.963423 (+ 154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.963483 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.965200 (+ 1717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:17.965201 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:17.965202 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:17.965206 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:17.966224 (+ 1018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.966497 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.966498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.966498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.966540 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:17.966670 (+ 130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:17.966670 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:17.966671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:17.966738 (+ 67us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:17.966794 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:17.966864 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 00:05:17.966924 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:05:17.968396 21737 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45582:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:17.970053 21737 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:17.975989 22311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.971945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:42719 (local address 127.0.0.1:41048)
0812 00:05:17.972107 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:17.972146 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:17.972208 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:17.972471 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:17.972479 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:17.972481 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:17.972560 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.972561 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.973945 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.973946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.974889 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.974891 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.975738 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.975739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.975805 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.975815 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 00:05:17.975877 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 00:05:17.975923 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":72,"thread_start_us":65,"threads_started":1}
I20260812 00:05:17.976037 22313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.972047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41048 (local address 127.19.59.66:42719)
0812 00:05:17.972262 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:17.972266 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:17.972277 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:05:17.972312 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:17.972314 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:17.972329 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:17.972402 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:17.972670 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.973809 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.974971 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.975654 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.975731 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.975782 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:17.975896 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 00:05:17.975937 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":96,"threads_started":1}
I20260812 00:05:17.976214 22314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.972185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52568 (local address 127.19.59.67:44491)
0812 00:05:17.972336 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:17.972341 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:17.972529 (+ 188us) server_negotiation.cc:407] Connection header received
0812 00:05:17.972589 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:17.972591 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:17.972604 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:17.972677 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:17.972838 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.973800 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.975129 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.975685 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.975735 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.975781 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:17.976052 (+ 271us) server_negotiation.cc:299] Negotiation successful
0812 00:05:17.976093 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":70,"threads_started":1}
I20260812 00:05:17.976248 22316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.972220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53396 (local address 127.19.59.65:46727)
0812 00:05:17.972406 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:17.972410 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:17.973014 (+ 604us) server_negotiation.cc:407] Connection header received
0812 00:05:17.973056 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:17.973057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:17.973068 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:17.973148 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:17.973313 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.974099 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.975272 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.975710 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.975772 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.975823 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:17.976050 (+ 227us) server_negotiation.cc:299] Negotiation successful
0812 00:05:17.976116 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":102,"threads_started":1}
I20260812 00:05:17.976544 22309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.971994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46727 (local address 127.0.0.1:53396)
0812 00:05:17.972906 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:17.972913 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:17.972966 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:17.973206 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:17.973206 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:17.973208 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:17.973250 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.973251 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.974186 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.974187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.975205 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.975206 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.975852 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.975853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.975909 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.975912 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:17.975962 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:05:17.975993 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":900,"thread_start_us":69,"threads_started":1}
I20260812 00:05:17.976552 22312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.971961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:44491 (local address 127.0.0.1:52568)
0812 00:05:17.972443 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:17.972453 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:17.972518 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:17.972682 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:17.972683 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:17.972685 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:17.972749 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.972750 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.973911 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.973912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.975046 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.975049 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.975815 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.975816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.975885 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.975889 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:17.975943 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 00:05:17.975983 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":30,"thread_start_us":47,"threads_started":1}
I20260812 00:05:17.977072 22045 tablet_service.cc:1467] Processing CreateTablet for tablet 61cee6352b724ad88268b7ace93a1e0a (DEFAULT_TABLE table=test-table [id=fc261f4458db4707831ce287d42f9b48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:17.977155 22221 tablet_service.cc:1467] Processing CreateTablet for tablet 61cee6352b724ad88268b7ace93a1e0a (DEFAULT_TABLE table=test-table [id=fc261f4458db4707831ce287d42f9b48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:17.977159 21895 tablet_service.cc:1467] Processing CreateTablet for tablet 61cee6352b724ad88268b7ace93a1e0a (DEFAULT_TABLE table=test-table [id=fc261f4458db4707831ce287d42f9b48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:17.977425 22045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61cee6352b724ad88268b7ace93a1e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:17.977479 21895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61cee6352b724ad88268b7ace93a1e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:17.977476 22221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61cee6352b724ad88268b7ace93a1e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:17.980227 22317 tablet_bootstrap.cc:492] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47: Bootstrap starting.
I20260812 00:05:17.980856 22318 tablet_bootstrap.cc:492] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b: Bootstrap starting.
I20260812 00:05:17.980955 22317 tablet_bootstrap.cc:654] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:17.980942 22319 tablet_bootstrap.cc:492] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb: Bootstrap starting.
I20260812 00:05:17.981391 22317 log.cc:824] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:17.981539 22319 tablet_bootstrap.cc:654] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:17.981858 22319 log.cc:824] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:17.981937 22318 tablet_bootstrap.cc:654] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:17.982234 22317 tablet_bootstrap.cc:492] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47: No bootstrap required, opened a new log
I20260812 00:05:17.982313 22317 ts_tablet_manager.cc:1397] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:17.982322 22318 log.cc:824] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:17.982707 22319 tablet_bootstrap.cc:492] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb: No bootstrap required, opened a new log
I20260812 00:05:17.982771 22319 ts_tablet_manager.cc:1397] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:17.983037 22318 tablet_bootstrap.cc:492] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b: No bootstrap required, opened a new log
I20260812 00:05:17.983112 22318 ts_tablet_manager.cc:1397] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:05:17.984184 22317 raft_consensus.cc:348] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } }
I20260812 00:05:17.984341 22317 raft_consensus.cc:374] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:17.984371 22317 raft_consensus.cc:729] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 307f6b1c467a4d33b13d093da040aa47, State: Initialized, Role: FOLLOWER
I20260812 00:05:17.984491 22317 consensus_queue.cc:260] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } }
I20260812 00:05:17.984555 22319 raft_consensus.cc:348] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } }
I20260812 00:05:17.984681 22319 raft_consensus.cc:374] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:17.984712 22319 raft_consensus.cc:729] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062953e2d566492ea8645c1c370122fb, State: Initialized, Role: FOLLOWER
I20260812 00:05:17.984740 22317 ts_tablet_manager.cc:1428] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:05:17.984788 22135 heartbeater.cc:503] Master 127.19.59.126:45959 was elected leader, sending a full tablet report...
I20260812 00:05:17.984809 22319 consensus_queue.cc:260] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } }
I20260812 00:05:17.984674 22318 raft_consensus.cc:348] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } }
I20260812 00:05:17.985069 22319 ts_tablet_manager.cc:1428] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:17.985106 21981 heartbeater.cc:503] Master 127.19.59.126:45959 was elected leader, sending a full tablet report...
I20260812 00:05:17.985105 22318 raft_consensus.cc:374] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:17.985155 22318 raft_consensus.cc:729] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e04934d4d9b4ad1b36a9123f23dfa1b, State: Initialized, Role: FOLLOWER
I20260812 00:05:17.985267 22318 consensus_queue.cc:260] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } }
I20260812 00:05:17.985708 22318 ts_tablet_manager.cc:1428] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260812 00:05:17.985991 22293 heartbeater.cc:503] Master 127.19.59.126:45959 was elected leader, sending a full tablet report...
I20260812 00:05:17.987701 22325 raft_consensus.cc:482] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:17.987787 22325 raft_consensus.cc:504] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } }
I20260812 00:05:17.988035 22325 leader_election.cc:288] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e04934d4d9b4ad1b36a9123f23dfa1b (127.19.59.67:44491), 062953e2d566492ea8645c1c370122fb (127.19.59.65:46727)
I20260812 00:05:17.991268 22314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.988374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:56261 (local address 127.19.59.67:44491)
0812 00:05:17.988404 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:17.988406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:17.988411 (+ 5us) server_negotiation.cc:407] Connection header received
0812 00:05:17.988428 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:17.988429 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:17.988436 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:17.988478 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:17.988624 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.989175 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.990453 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.990941 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.991013 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.991019 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:17.991183 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 00:05:17.991221 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 00:05:17.991278 22328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.988152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:44491 (local address 127.19.59.66:56261)
0812 00:05:17.988288 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:17.988297 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:17.988334 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:17.988485 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:17.988485 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:17.988486 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:17.988556 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.988557 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.989234 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.989234 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.990371 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.990374 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.991045 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.991046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.991119 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.991122 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:17.991161 (+ 39us) client_negotiation.cc:240] Negotiation successful
0812 00:05:17.991187 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":53,"thread_start_us":73,"threads_started":1}
I20260812 00:05:17.991330 22316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.988189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:47645 (local address 127.19.59.65:46727)
0812 00:05:17.988232 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:17.988234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:17.988281 (+ 47us) server_negotiation.cc:407] Connection header received
0812 00:05:17.988345 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:17.988346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:17.988352 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:17.988413 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:17.988549 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.989162 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.990453 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.990955 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.991013 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.991019 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:17.991233 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 00:05:17.991267 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:05:17.991602 22246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61cee6352b724ad88268b7ace93a1e0a" candidate_uuid: "307f6b1c467a4d33b13d093da040aa47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" is_pre_election: true
I20260812 00:05:17.991729 22246 raft_consensus.cc:2454] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 307f6b1c467a4d33b13d093da040aa47 in term 0.
I20260812 00:05:17.991804 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:17.988152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46727 (local address 127.19.59.66:47645)
0812 00:05:17.988232 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:17.988242 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:17.988296 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:17.988417 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:17.988418 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:17.988419 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:17.988484 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.988485 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.989233 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.989234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.990371 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:17.990374 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:17.991053 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:17.991054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:17.991146 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:17.991162 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 00:05:17.991217 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 00:05:17.991254 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":37}
I20260812 00:05:17.991943 22011 leader_election.cc:302] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 307f6b1c467a4d33b13d093da040aa47, 4e04934d4d9b4ad1b36a9123f23dfa1b; no voters:
I20260812 00:05:17.992057 22325 raft_consensus.cc:2781] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:17.992108 22325 raft_consensus.cc:482] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:17.992131 22325 raft_consensus.cc:3037] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:17.992097 21929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61cee6352b724ad88268b7ace93a1e0a" candidate_uuid: "307f6b1c467a4d33b13d093da040aa47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062953e2d566492ea8645c1c370122fb" is_pre_election: true
I20260812 00:05:17.992225 21929 raft_consensus.cc:2454] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 307f6b1c467a4d33b13d093da040aa47 in term 0.
I20260812 00:05:17.992758 22325 raft_consensus.cc:504] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } }
I20260812 00:05:17.992892 22325 leader_election.cc:288] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [CANDIDATE]: Term 1 election: Requested vote from peers 4e04934d4d9b4ad1b36a9123f23dfa1b (127.19.59.67:44491), 062953e2d566492ea8645c1c370122fb (127.19.59.65:46727)
I20260812 00:05:17.993027 21929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61cee6352b724ad88268b7ace93a1e0a" candidate_uuid: "307f6b1c467a4d33b13d093da040aa47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062953e2d566492ea8645c1c370122fb"
I20260812 00:05:17.993089 21929 raft_consensus.cc:3037] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:17.993101 22246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61cee6352b724ad88268b7ace93a1e0a" candidate_uuid: "307f6b1c467a4d33b13d093da040aa47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b"
I20260812 00:05:17.993176 22246 raft_consensus.cc:3037] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:17.993687 21929 raft_consensus.cc:2454] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 307f6b1c467a4d33b13d093da040aa47 in term 1.
I20260812 00:05:17.993749 22246 raft_consensus.cc:2454] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 307f6b1c467a4d33b13d093da040aa47 in term 1.
I20260812 00:05:17.994144 22008 leader_election.cc:302] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062953e2d566492ea8645c1c370122fb, 307f6b1c467a4d33b13d093da040aa47; no voters:
I20260812 00:05:17.994249 22325 raft_consensus.cc:2781] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:17.994392 22325 raft_consensus.cc:686] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [term 1 LEADER]: Becoming Leader. State: Replica: 307f6b1c467a4d33b13d093da040aa47, State: Running, Role: LEADER
I20260812 00:05:17.994479 22325 consensus_queue.cc:237] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } }
I20260812 00:05:17.995069 21737 catalog_manager.cc:5495] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 307f6b1c467a4d33b13d093da040aa47 (127.19.59.66). New cstate: current_term: 1 leader_uuid: "307f6b1c467a4d33b13d093da040aa47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } health_report { overall_health: UNKNOWN } } }
Aug 12 00:05:18 dist-test-slave-6nmv krb5kdc[21689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493117, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:18.029224 21799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.022500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45588 (local address 127.19.59.126:45959)
0812 00:05:18.022558 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:18.022561 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:18.022694 (+ 133us) server_negotiation.cc:407] Connection header received
0812 00:05:18.022774 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:18.022775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:18.022785 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:18.022849 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:18.023288 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.023752 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.024393 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.024554 (+ 161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.024627 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.026835 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:18.026836 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:18.026837 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:18.026844 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:18.028050 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:18.028424 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:18.028426 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:18.028426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:18.028484 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:18.028660 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:18.028661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:18.028661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:18.028764 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:18.028829 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:18.028980 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 00:05:18.029112 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":16,"server-negotiator.queue_time_us":31}
I20260812 00:05:18.029299 22337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.022439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:45959 (local address 127.0.0.1:45588)
0812 00:05:18.022623 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:18.022632 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:18.022713 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:18.022855 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:18.022856 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:18.023166 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:18.023209 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.023212 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.023846 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.023847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.024315 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.024316 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.024627 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.024628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.024679 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.025295 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:18.025300 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:18.026754 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:18.028149 (+ 1395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:18.028156 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:18.028175 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:18.028356 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:18.028543 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:18.028544 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:18.028544 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:18.028602 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:18.028829 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:18.028837 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:18.028880 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 00:05:18.028955 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:05:18.029180 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":102,"thread_start_us":70,"threads_started":1}
I20260812 00:05:18.031214 21737 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:45588:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 00:05:18.031512 21737 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:18.032995 21895 tablet_service.cc:1467] Processing CreateTablet for tablet 1ee7dea4583c40b78e5fc89591dd2675 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2abe6aa1eccf4b0ea74de3345ef18d9c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:05:18.033079 22221 tablet_service.cc:1467] Processing CreateTablet for tablet 1ee7dea4583c40b78e5fc89591dd2675 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2abe6aa1eccf4b0ea74de3345ef18d9c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:05:18.033056 22045 tablet_service.cc:1467] Processing CreateTablet for tablet 1ee7dea4583c40b78e5fc89591dd2675 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2abe6aa1eccf4b0ea74de3345ef18d9c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:05:18.033183 21895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ee7dea4583c40b78e5fc89591dd2675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:18.033203 22221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ee7dea4583c40b78e5fc89591dd2675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:18.033237 22045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ee7dea4583c40b78e5fc89591dd2675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:18.034705 22318 tablet_bootstrap.cc:492] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b: Bootstrap starting.
I20260812 00:05:18.034701 22317 tablet_bootstrap.cc:492] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47: Bootstrap starting.
I20260812 00:05:18.035168 22317 tablet_bootstrap.cc:654] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:18.035212 22318 tablet_bootstrap.cc:654] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:18.035575 22319 tablet_bootstrap.cc:492] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb: Bootstrap starting.
I20260812 00:05:18.035964 22318 tablet_bootstrap.cc:492] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b: No bootstrap required, opened a new log
I20260812 00:05:18.036007 22318 ts_tablet_manager.cc:1397] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:18.036141 22318 raft_consensus.cc:348] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.036204 22318 raft_consensus.cc:374] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:18.036218 22318 raft_consensus.cc:729] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e04934d4d9b4ad1b36a9123f23dfa1b, State: Initialized, Role: FOLLOWER
I20260812 00:05:18.036270 22318 consensus_queue.cc:260] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.036355 22318 ts_tablet_manager.cc:1428] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:18.036372 22319 tablet_bootstrap.cc:654] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:18.036403 22327 tablet_replica.cc:439] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } }
I20260812 00:05:18.036468 22327 tablet_replica.cc:442] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:18.036974 22317 tablet_bootstrap.cc:492] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47: No bootstrap required, opened a new log
I20260812 00:05:18.037040 22317 ts_tablet_manager.cc:1397] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:18.037211 22317 raft_consensus.cc:348] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.037304 22317 raft_consensus.cc:374] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:18.037326 22317 raft_consensus.cc:729] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 307f6b1c467a4d33b13d093da040aa47, State: Initialized, Role: FOLLOWER
I20260812 00:05:18.037374 22317 consensus_queue.cc:260] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.037460 22317 ts_tablet_manager.cc:1428] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:18.037475 22325 tablet_replica.cc:439] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } }
I20260812 00:05:18.037566 22325 tablet_replica.cc:442] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:18.037707 22319 tablet_bootstrap.cc:492] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb: No bootstrap required, opened a new log
I20260812 00:05:18.037762 22319 ts_tablet_manager.cc:1397] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:18.037941 22319 raft_consensus.cc:348] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.038017 22319 raft_consensus.cc:374] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:18.038045 22319 raft_consensus.cc:729] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062953e2d566492ea8645c1c370122fb, State: Initialized, Role: FOLLOWER
I20260812 00:05:18.038092 22319 consensus_queue.cc:260] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.038188 22319 ts_tablet_manager.cc:1428] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:18.038233 22326 tablet_replica.cc:439] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } }
I20260812 00:05:18.038323 22326 tablet_replica.cc:442] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 00:05:18.044013 22136 tablet.cc:2369] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:05:18.077632 22327 raft_consensus.cc:482] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:18.077713 22327 raft_consensus.cc:504] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.078073 22327 leader_election.cc:288] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 062953e2d566492ea8645c1c370122fb (127.19.59.65:46727), 307f6b1c467a4d33b13d093da040aa47 (127.19.59.66:42719)
I20260812 00:05:18.080847 22313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.078269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:43017 (local address 127.19.59.66:42719)
0812 00:05:18.078328 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:18.078329 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:18.078336 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:18.078382 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:18.078383 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:18.078392 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:18.078478 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:18.078774 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.079189 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.080034 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.080425 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.080501 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.080511 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:18.080716 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 00:05:18.080753 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:05:18.080842 22173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.078222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:42719 (local address 127.19.59.67:43017)
0812 00:05:18.078262 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:18.078273 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:18.078311 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:18.078486 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:18.078488 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:18.078489 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:18.078572 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.078573 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.079268 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.079269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.079944 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.079952 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.080545 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.080546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.080641 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.080645 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:18.080696 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:05:18.080745 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22,"mutex_wait_us":21}
I20260812 00:05:18.080917 22316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.078339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:54783 (local address 127.19.59.65:46727)
0812 00:05:18.078405 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:18.078407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:18.078619 (+ 212us) server_negotiation.cc:407] Connection header received
0812 00:05:18.078664 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:18.078665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:18.078679 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:18.078725 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:18.078870 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.079288 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.080117 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.080601 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.080672 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.080681 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:18.080822 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 00:05:18.080853 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 00:05:18.080977 22343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.078222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46727 (local address 127.19.59.67:54783)
0812 00:05:18.078560 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:18.078568 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:18.078614 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:18.078749 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:18.078749 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:18.078750 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:18.078807 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.078808 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.079370 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.079371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.080031 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.080033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.080681 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.080682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.080745 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.080748 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:18.080809 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 00:05:18.080835 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":145,"thread_start_us":141,"threads_started":1}
I20260812 00:05:18.081178 21929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ee7dea4583c40b78e5fc89591dd2675" candidate_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062953e2d566492ea8645c1c370122fb" is_pre_election: true
I20260812 00:05:18.081190 22085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ee7dea4583c40b78e5fc89591dd2675" candidate_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "307f6b1c467a4d33b13d093da040aa47" is_pre_election: true
I20260812 00:05:18.081259 21929 raft_consensus.cc:2454] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e04934d4d9b4ad1b36a9123f23dfa1b in term 0.
I20260812 00:05:18.081316 22085 raft_consensus.cc:2454] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e04934d4d9b4ad1b36a9123f23dfa1b in term 0.
I20260812 00:05:18.081429 22164 leader_election.cc:302] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062953e2d566492ea8645c1c370122fb, 4e04934d4d9b4ad1b36a9123f23dfa1b; no voters:
I20260812 00:05:18.081631 22327 raft_consensus.cc:2781] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:18.081679 22327 raft_consensus.cc:482] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:18.081699 22327 raft_consensus.cc:3037] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:18.082429 22327 raft_consensus.cc:504] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.082566 22327 leader_election.cc:288] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [CANDIDATE]: Term 1 election: Requested vote from peers 062953e2d566492ea8645c1c370122fb (127.19.59.65:46727), 307f6b1c467a4d33b13d093da040aa47 (127.19.59.66:42719)
I20260812 00:05:18.082715 22085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ee7dea4583c40b78e5fc89591dd2675" candidate_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "307f6b1c467a4d33b13d093da040aa47"
I20260812 00:05:18.082708 21929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ee7dea4583c40b78e5fc89591dd2675" candidate_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062953e2d566492ea8645c1c370122fb"
I20260812 00:05:18.082785 22085 raft_consensus.cc:3037] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:18.082803 21929 raft_consensus.cc:3037] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:18.083376 21929 raft_consensus.cc:2454] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e04934d4d9b4ad1b36a9123f23dfa1b in term 1.
I20260812 00:05:18.083446 22085 raft_consensus.cc:2454] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e04934d4d9b4ad1b36a9123f23dfa1b in term 1.
I20260812 00:05:18.083575 22164 leader_election.cc:302] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062953e2d566492ea8645c1c370122fb, 4e04934d4d9b4ad1b36a9123f23dfa1b; no voters:
I20260812 00:05:18.083674 22327 raft_consensus.cc:2781] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:18.083808 22327 raft_consensus.cc:686] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 LEADER]: Becoming Leader. State: Replica: 4e04934d4d9b4ad1b36a9123f23dfa1b, State: Running, Role: LEADER
I20260812 00:05:18.083907 22327 consensus_queue.cc:237] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.084316 22345 tablet_replica.cc:439] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b: TxnStatusTablet state changed. Reason: New leader 4e04934d4d9b4ad1b36a9123f23dfa1b. Latest consensus state: current_term: 1 leader_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } }
I20260812 00:05:18.084396 22345 tablet_replica.cc:442] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:05:18.084597 22348 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 00:05:18.084717 22348 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 00:05:18.084707 21737 catalog_manager.cc:5495] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e04934d4d9b4ad1b36a9123f23dfa1b (127.19.59.67). New cstate: current_term: 1 leader_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } health_report { overall_health: HEALTHY } } }
I20260812 00:05:18.097489 22314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.094668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52584 (local address 127.19.59.67:44491)
0812 00:05:18.094725 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:18.094727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:18.094735 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:18.094766 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:18.094767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:18.094783 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:18.094843 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:18.094981 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.095624 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.096454 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.096772 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.096838 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.097089 (+ 251us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:18.097195 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:18.097281 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:18.097389 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 00:05:18.097408 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:05:18.097467 22337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.094566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:44491 (local address 127.0.0.1:52584)
0812 00:05:18.094637 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:18.094649 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:18.094701 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:18.094882 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:18.094883 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:18.094884 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:05:18.094925 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.094927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.095736 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.095738 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.096332 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.096335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.096919 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.096920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.096981 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.096995 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:05:18.097292 (+ 297us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:05:18.097320 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 00:05:18.097374 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 00:05:18.097418 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 00:05:18.099015 22085 raft_consensus.cc:1261] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Refusing update from remote peer 4e04934d4d9b4ad1b36a9123f23dfa1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:18.099025 21929 raft_consensus.cc:1261] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Refusing update from remote peer 4e04934d4d9b4ad1b36a9123f23dfa1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:18.099274 22345 consensus_queue.cc:1035] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:18.099367 22327 consensus_queue.cc:1035] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:18.100445 22326 tablet_replica.cc:439] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb: TxnStatusTablet state changed. Reason: New leader 4e04934d4d9b4ad1b36a9123f23dfa1b. Latest consensus state: current_term: 1 leader_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } }
I20260812 00:05:18.100535 22326 tablet_replica.cc:442] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:18.100592 22325 tablet_replica.cc:439] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47: TxnStatusTablet state changed. Reason: New leader 4e04934d4d9b4ad1b36a9123f23dfa1b. Latest consensus state: current_term: 1 leader_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } }
I20260812 00:05:18.100679 22325 tablet_replica.cc:442] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:18.101630 22327 tablet_replica.cc:439] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } }
I20260812 00:05:18.101724 22327 tablet_replica.cc:442] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:05:18.101845 22327 tablet_replica.cc:439] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } }
I20260812 00:05:18.101904 22327 tablet_replica.cc:442] T 1ee7dea4583c40b78e5fc89591dd2675 P 4e04934d4d9b4ad1b36a9123f23dfa1b: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:05:18.101871 22326 tablet_replica.cc:439] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } }
I20260812 00:05:18.101939 22326 tablet_replica.cc:442] T 1ee7dea4583c40b78e5fc89591dd2675 P 062953e2d566492ea8645c1c370122fb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:18.101984 22351 mvcc.cc:205] Tried to move back new op lower bound from 7317475811731439616 to 7317475811672338432. Current Snapshot: MvccSnapshot[applied={T|T < 7317475811731439616}]
I20260812 00:05:18.102473 22325 tablet_replica.cc:439] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } } }
I20260812 00:05:18.102553 22325 tablet_replica.cc:442] T 1ee7dea4583c40b78e5fc89591dd2675 P 307f6b1c467a4d33b13d093da040aa47: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:18.102754 22352 mvcc.cc:205] Tried to move back new op lower bound from 7317475811731439616 to 7317475811672338432. Current Snapshot: MvccSnapshot[applied={T|T < 7317475811731439616}]
I20260812 00:05:18.103325 22353 mvcc.cc:205] Tried to move back new op lower bound from 7317475811731439616 to 7317475811672338432. Current Snapshot: MvccSnapshot[applied={T|T < 7317475811731439616}]
I20260812 00:05:18.106846 22313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.104418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41056 (local address 127.19.59.66:42719)
0812 00:05:18.104452 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:18.104454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:18.104462 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:18.104536 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:18.104537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:18.104551 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:18.104601 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:18.104748 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.105350 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.106122 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.106425 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.106494 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.106590 (+ 96us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:18.106683 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:18.106739 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:18.106771 (+ 32us) server_negotiation.cc:299] Negotiation successful
0812 00:05:18.106788 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:05:18.111248 22314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.109126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:59137 (local address 127.19.59.67:44491)
0812 00:05:18.109160 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:18.109162 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:18.109168 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:05:18.109183 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:18.109183 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:18.109189 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:18.109228 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:18.109364 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.109760 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.110724 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.110872 (+ 148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.110918 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.111098 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:18.111118 (+ 20us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:18.111151 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:18.111198 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 00:05:18.111209 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:05:18.111294 22142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.108942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:44491 (local address 127.19.59.66:59137)
0812 00:05:18.109007 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:18.109017 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:18.109058 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:18.109248 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:18.109249 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:18.109250 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:05:18.109306 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.109307 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.109832 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.109833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.110644 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.110647 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.110942 (+ 295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.110943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.111004 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.111018 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:05:18.111152 (+ 134us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:05:18.111153 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 00:05:18.111197 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:05:18.111231 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 00:05:18.113569 21929 raft_consensus.cc:1261] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Refusing update from remote peer 307f6b1c467a4d33b13d093da040aa47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:18.113641 22246 raft_consensus.cc:1261] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Refusing update from remote peer 307f6b1c467a4d33b13d093da040aa47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:18.113788 22330 consensus_queue.cc:1035] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:18.113906 22325 consensus_queue.cc:1035] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:18.121253 22313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.119130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:34269 (local address 127.19.59.66:42719)
0812 00:05:18.119165 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:18.119167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:18.119174 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:18.119191 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:18.119192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:18.119199 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:18.119245 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:18.119333 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.119906 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.120577 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.120838 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.120896 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.121091 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:18.121115 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:18.121153 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:18.121201 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 00:05:18.121216 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 00:05:18.121299 22300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.118959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:42719 (local address 127.19.59.67:34269)
0812 00:05:18.119023 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:18.119034 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:18.119068 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:18.119248 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:18.119249 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:18.119249 (+ 0us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:05:18.119291 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.119292 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.119985 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.119985 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.120501 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.120503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.120938 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.120939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.121005 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.121019 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:05:18.121154 (+ 135us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:05:18.121155 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 00:05:18.121198 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 00:05:18.121235 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:05:18.127669 21738 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:18.127765 21738 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:18.128430 21738 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec: Sending DeleteTablet for 3 replicas of tablet 61cee6352b724ad88268b7ace93a1e0a
I20260812 00:05:18.128789 22045 tablet_service.cc:1514] Processing DeleteTablet for tablet 61cee6352b724ad88268b7ace93a1e0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:18 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:41048
I20260812 00:05:18.128789 21895 tablet_service.cc:1514] Processing DeleteTablet for tablet 61cee6352b724ad88268b7ace93a1e0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:18 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:53396
I20260812 00:05:18.129060 22221 tablet_service.cc:1514] Processing DeleteTablet for tablet 61cee6352b724ad88268b7ace93a1e0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:18 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:52568
I20260812 00:05:18.129423 22379 tablet_replica.cc:330] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b: stopping tablet replica
I20260812 00:05:18.129432 21738 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45582:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 00:05:18.129544 22379 raft_consensus.cc:2229] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260812 00:05:18.129552 21738 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:18.129593 22379 raft_consensus.cc:2258] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:18.129974 22379 ts_tablet_manager.cc:1905] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:18.130856 21895 tablet_service.cc:1467] Processing CreateTablet for tablet 233a39ed2a8447c995627b390edb04eb (DEFAULT_TABLE table=test-table [id=449e15513b3e49b59b0c39207e4ee056]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:18.130966 21895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 233a39ed2a8447c995627b390edb04eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:18.131558 22379 ts_tablet_manager.cc:1918] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:05:18.131637 22379 log.cc:1196] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/61cee6352b724ad88268b7ace93a1e0a
I20260812 00:05:18.131896 22379 ts_tablet_manager.cc:1939] T 61cee6352b724ad88268b7ace93a1e0a P 4e04934d4d9b4ad1b36a9123f23dfa1b: Deleting consensus metadata
I20260812 00:05:18.132332 22319 tablet_bootstrap.cc:492] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb: Bootstrap starting.
I20260812 00:05:18.132587 22045 tablet_service.cc:1467] Processing CreateTablet for tablet 233a39ed2a8447c995627b390edb04eb (DEFAULT_TABLE table=test-table [id=449e15513b3e49b59b0c39207e4ee056]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:18.132681 22045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 233a39ed2a8447c995627b390edb04eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:18.132733 22319 tablet_bootstrap.cc:654] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:18.133621 22317 tablet_bootstrap.cc:492] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47: Bootstrap starting.
I20260812 00:05:18.133724 21723 catalog_manager.cc:4841] TS 4e04934d4d9b4ad1b36a9123f23dfa1b (127.19.59.67:44491): tablet 61cee6352b724ad88268b7ace93a1e0a (table test-table [id=fc261f4458db4707831ce287d42f9b48]) successfully deleted
I20260812 00:05:18.133846 22221 tablet_service.cc:1467] Processing CreateTablet for tablet 233a39ed2a8447c995627b390edb04eb (DEFAULT_TABLE table=test-table [id=449e15513b3e49b59b0c39207e4ee056]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:18.133931 22221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 233a39ed2a8447c995627b390edb04eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:18.134012 22317 tablet_bootstrap.cc:654] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:18.134900 22318 tablet_bootstrap.cc:492] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b: Bootstrap starting.
I20260812 00:05:18.135310 22318 tablet_bootstrap.cc:654] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:18.136027 22319 tablet_bootstrap.cc:492] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb: No bootstrap required, opened a new log
I20260812 00:05:18.136094 22319 ts_tablet_manager.cc:1397] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260812 00:05:18.136204 22318 tablet_bootstrap.cc:492] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b: No bootstrap required, opened a new log
I20260812 00:05:18.136240 22318 ts_tablet_manager.cc:1397] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:18.136230 22319 raft_consensus.cc:348] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.136296 22319 raft_consensus.cc:374] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:18.136322 22319 raft_consensus.cc:729] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062953e2d566492ea8645c1c370122fb, State: Initialized, Role: FOLLOWER
I20260812 00:05:18.136360 22319 consensus_queue.cc:260] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.136374 22318 raft_consensus.cc:348] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.136427 22318 raft_consensus.cc:374] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:18.136446 22318 raft_consensus.cc:729] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e04934d4d9b4ad1b36a9123f23dfa1b, State: Initialized, Role: FOLLOWER
I20260812 00:05:18.136459 22319 ts_tablet_manager.cc:1428] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:18.136482 22318 consensus_queue.cc:260] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.136570 22318 ts_tablet_manager.cc:1428] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:18.138057 22378 tablet_replica.cc:330] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47: stopping tablet replica
I20260812 00:05:18.138154 22378 raft_consensus.cc:2229] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:18.138252 22378 raft_consensus.cc:2258] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:18.138604 22378 ts_tablet_manager.cc:1905] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:18.140004 22378 ts_tablet_manager.cc:1918] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:05:18.140077 22378 log.cc:1196] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/61cee6352b724ad88268b7ace93a1e0a
I20260812 00:05:18.140333 22378 ts_tablet_manager.cc:1939] T 61cee6352b724ad88268b7ace93a1e0a P 307f6b1c467a4d33b13d093da040aa47: Deleting consensus metadata
I20260812 00:05:18.140668 21721 catalog_manager.cc:4841] TS 307f6b1c467a4d33b13d093da040aa47 (127.19.59.66:42719): tablet 61cee6352b724ad88268b7ace93a1e0a (table test-table [id=fc261f4458db4707831ce287d42f9b48]) successfully deleted
I20260812 00:05:18.141913 22376 tablet_replica.cc:330] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb: stopping tablet replica
W20260812 00:05:18.142084 21982 tablet.cc:2369] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:05:18.142282 22376 raft_consensus.cc:2229] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:18.142366 22376 raft_consensus.cc:2258] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:18.142726 22376 ts_tablet_manager.cc:1905] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:18.143970 22376 ts_tablet_manager.cc:1918] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:05:18.144061 22376 log.cc:1196] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/wal/wals/61cee6352b724ad88268b7ace93a1e0a
I20260812 00:05:18.144320 22376 ts_tablet_manager.cc:1939] T 61cee6352b724ad88268b7ace93a1e0a P 062953e2d566492ea8645c1c370122fb: Deleting consensus metadata
I20260812 00:05:18.144712 21720 catalog_manager.cc:4841] TS 062953e2d566492ea8645c1c370122fb (127.19.59.65:46727): tablet 61cee6352b724ad88268b7ace93a1e0a (table test-table [id=fc261f4458db4707831ce287d42f9b48]) successfully deleted
I20260812 00:05:18.146142 22317 tablet_bootstrap.cc:492] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47: No bootstrap required, opened a new log
I20260812 00:05:18.146199 22317 ts_tablet_manager.cc:1397] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20260812 00:05:18.146328 22317 raft_consensus.cc:348] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.146369 22317 raft_consensus.cc:374] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:18.146381 22317 raft_consensus.cc:729] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 307f6b1c467a4d33b13d093da040aa47, State: Initialized, Role: FOLLOWER
I20260812 00:05:18.146428 22317 consensus_queue.cc:260] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.146517 22317 ts_tablet_manager.cc:1428] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260812 00:05:18.184705 22294 tablet.cc:2369] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:05:18.372314 22326 raft_consensus.cc:482] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:18.372430 22326 raft_consensus.cc:504] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.372789 22326 leader_election.cc:288] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 307f6b1c467a4d33b13d093da040aa47 (127.19.59.66:42719), 4e04934d4d9b4ad1b36a9123f23dfa1b (127.19.59.67:44491)
I20260812 00:05:18.375644 22313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.373097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:48109 (local address 127.19.59.66:42719)
0812 00:05:18.373139 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:18.373141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:18.373192 (+ 51us) server_negotiation.cc:407] Connection header received
0812 00:05:18.373259 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:18.373260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:18.373272 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:18.373322 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:18.373427 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.373993 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.374913 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.375285 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.375362 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.375371 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:18.375532 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 00:05:18.375577 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:05:18.375649 22384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.372925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:42719 (local address 127.19.59.65:48109)
0812 00:05:18.373103 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:18.373114 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:18.373197 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:18.373326 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:18.373327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:18.373329 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:18.373382 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.373384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.374070 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.374071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.374816 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.374818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.375362 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.375363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.375437 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.375440 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:18.375523 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 00:05:18.375576 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":85,"threads_started":1}
I20260812 00:05:18.375918 22085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "233a39ed2a8447c995627b390edb04eb" candidate_uuid: "062953e2d566492ea8645c1c370122fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "307f6b1c467a4d33b13d093da040aa47" is_pre_election: true
I20260812 00:05:18.375979 22383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.372985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:44491 (local address 127.19.59.65:42981)
0812 00:05:18.373114 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:18.373125 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:18.373225 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:18.373388 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:18.373389 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:18.373391 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:18.373473 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.373475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.374265 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.374266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.375055 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.375058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.375754 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.375755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.375830 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.375833 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:18.375881 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 00:05:18.375915 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":67,"threads_started":1}
I20260812 00:05:18.375999 22314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.373061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:42981 (local address 127.19.59.67:44491)
0812 00:05:18.373118 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:18.373120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:18.373205 (+ 85us) server_negotiation.cc:407] Connection header received
0812 00:05:18.373294 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:18.373295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:18.373306 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:18.373383 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:18.373578 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.374174 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.375189 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.375624 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.375744 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.375752 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:18.375897 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 00:05:18.375934 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:05:18.376017 22085 raft_consensus.cc:2454] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062953e2d566492ea8645c1c370122fb in term 0.
I20260812 00:05:18.376267 21846 leader_election.cc:302] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062953e2d566492ea8645c1c370122fb, 307f6b1c467a4d33b13d093da040aa47; no voters:
I20260812 00:05:18.376356 22246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "233a39ed2a8447c995627b390edb04eb" candidate_uuid: "062953e2d566492ea8645c1c370122fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" is_pre_election: true
I20260812 00:05:18.376425 22326 raft_consensus.cc:2781] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:18.376474 22326 raft_consensus.cc:482] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:18.376474 22246 raft_consensus.cc:2454] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062953e2d566492ea8645c1c370122fb in term 0.
I20260812 00:05:18.376502 22326 raft_consensus.cc:3037] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:18.377261 22326 raft_consensus.cc:504] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.377421 22326 leader_election.cc:288] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [CANDIDATE]: Term 1 election: Requested vote from peers 307f6b1c467a4d33b13d093da040aa47 (127.19.59.66:42719), 4e04934d4d9b4ad1b36a9123f23dfa1b (127.19.59.67:44491)
I20260812 00:05:18.377585 22085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "233a39ed2a8447c995627b390edb04eb" candidate_uuid: "062953e2d566492ea8645c1c370122fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "307f6b1c467a4d33b13d093da040aa47"
I20260812 00:05:18.377701 22085 raft_consensus.cc:3037] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:18.377655 22246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "233a39ed2a8447c995627b390edb04eb" candidate_uuid: "062953e2d566492ea8645c1c370122fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b"
I20260812 00:05:18.377750 22246 raft_consensus.cc:3037] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:18.378414 22246 raft_consensus.cc:2454] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062953e2d566492ea8645c1c370122fb in term 1.
I20260812 00:05:18.378422 22085 raft_consensus.cc:2454] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062953e2d566492ea8645c1c370122fb in term 1.
I20260812 00:05:18.378592 21848 leader_election.cc:302] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062953e2d566492ea8645c1c370122fb, 4e04934d4d9b4ad1b36a9123f23dfa1b; no voters:
I20260812 00:05:18.378746 22326 raft_consensus.cc:2781] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:18.378942 22326 raft_consensus.cc:686] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [term 1 LEADER]: Becoming Leader. State: Replica: 062953e2d566492ea8645c1c370122fb, State: Running, Role: LEADER
I20260812 00:05:18.379029 22326 consensus_queue.cc:237] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:18.379750 21737 catalog_manager.cc:5495] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 062953e2d566492ea8645c1c370122fb (127.19.59.65). New cstate: current_term: 1 leader_uuid: "062953e2d566492ea8645c1c370122fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260812 00:05:18.421412 22316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.419490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53402 (local address 127.19.59.65:46727)
0812 00:05:18.419526 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:18.419528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:18.419537 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:18.419606 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:18.419607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:18.419626 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:18.419684 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:18.419758 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.420173 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.420834 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.420996 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.421041 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.421150 (+ 109us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:18.421242 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:18.421291 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:18.421319 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 00:05:18.421336 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 00:05:18.425593 22314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.423762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:43277 (local address 127.19.59.67:44491)
0812 00:05:18.423810 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:18.423811 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:18.423893 (+ 82us) server_negotiation.cc:407] Connection header received
0812 00:05:18.423928 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:18.423928 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:18.423936 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:18.423978 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:18.424048 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.424447 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.425057 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.425216 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.425262 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.425388 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:18.425409 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:18.425484 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:18.425524 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 00:05:18.425545 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:05:18.425796 22391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.423712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:44491 (local address 127.19.59.65:43277)
0812 00:05:18.423833 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:18.423841 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:18.423892 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:18.423978 (+ 86us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:18.423979 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:18.423980 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:05:18.424019 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.424019 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.424496 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.424496 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.424996 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.424997 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.425271 (+ 274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.425272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.425312 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.425323 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:05:18.425485 (+ 162us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:05:18.425487 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:05:18.425514 (+ 27us) client_negotiation.cc:240] Negotiation successful
0812 00:05:18.425545 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":65,"threads_started":1}
I20260812 00:05:18.427395 22246 raft_consensus.cc:1261] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Refusing update from remote peer 062953e2d566492ea8645c1c370122fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:18.427435 22085 raft_consensus.cc:1261] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Refusing update from remote peer 062953e2d566492ea8645c1c370122fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:18.427660 22326 consensus_queue.cc:1035] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:18.427806 22386 consensus_queue.cc:1035] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:18.434208 22316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.432172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:47311 (local address 127.19.59.65:46727)
0812 00:05:18.432205 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:18.432206 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:18.432214 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:18.432255 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:18.432260 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:18.432267 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:18.432329 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:18.432426 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.432905 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.433560 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.433756 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.433841 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.433969 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:18.433998 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:18.434050 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:18.434128 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 00:05:18.434148 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 00:05:18.434250 22300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:18.432123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46727 (local address 127.19.59.67:47311)
0812 00:05:18.432169 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:18.432178 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:18.432216 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:18.432337 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:18.432337 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:18.432338 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:05:18.432376 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.432377 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.432980 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.432981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.433482 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:18.433484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:18.433839 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:18.433840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:18.433892 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:18.433896 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:05:18.434064 (+ 168us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:05:18.434067 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:18.434112 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:05:18.434163 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 00:05:18.434597 22352 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 00:05:19.952939 21738 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:19.953044 21738 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:19.953941 21738 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec: Sending DeleteTablet for 3 replicas of tablet 233a39ed2a8447c995627b390edb04eb
I20260812 00:05:19.954249 22045 tablet_service.cc:1514] Processing DeleteTablet for tablet 233a39ed2a8447c995627b390edb04eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:19 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:41048
I20260812 00:05:19.954457 22221 tablet_service.cc:1514] Processing DeleteTablet for tablet 233a39ed2a8447c995627b390edb04eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:19 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:52568
I20260812 00:05:19.954658 22421 tablet_replica.cc:330] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b: stopping tablet replica
I20260812 00:05:19.954645 21895 tablet_service.cc:1514] Processing DeleteTablet for tablet 233a39ed2a8447c995627b390edb04eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:19 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:53396
I20260812 00:05:19.954739 22421 raft_consensus.cc:2229] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:19.954800 22421 raft_consensus.cc:2258] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:19.954838 22420 tablet_replica.cc:330] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47: stopping tablet replica
I20260812 00:05:19.954995 22420 raft_consensus.cc:2229] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:19.955056 22420 raft_consensus.cc:2258] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:19.955068 22421 ts_tablet_manager.cc:1905] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:19.955194 22422 tablet_replica.cc:330] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb: stopping tablet replica
I20260812 00:05:19.955261 22422 raft_consensus.cc:2229] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:19.955389 22422 raft_consensus.cc:2258] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:19.955653 22422 ts_tablet_manager.cc:1905] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:19.956789 22421 ts_tablet_manager.cc:1918] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:05:19.956926 22421 log.cc:1196] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/233a39ed2a8447c995627b390edb04eb
I20260812 00:05:19.957207 22421 ts_tablet_manager.cc:1939] T 233a39ed2a8447c995627b390edb04eb P 4e04934d4d9b4ad1b36a9123f23dfa1b: Deleting consensus metadata
I20260812 00:05:19.957540 21723 catalog_manager.cc:4841] TS 4e04934d4d9b4ad1b36a9123f23dfa1b (127.19.59.67:44491): tablet 233a39ed2a8447c995627b390edb04eb (table test-table [id=449e15513b3e49b59b0c39207e4ee056]) successfully deleted
I20260812 00:05:19.957911 22422 ts_tablet_manager.cc:1918] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:05:19.957984 22422 log.cc:1196] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/wal/wals/233a39ed2a8447c995627b390edb04eb
I20260812 00:05:19.958102 22420 ts_tablet_manager.cc:1905] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:19.958312 22422 ts_tablet_manager.cc:1939] T 233a39ed2a8447c995627b390edb04eb P 062953e2d566492ea8645c1c370122fb: Deleting consensus metadata
I20260812 00:05:19.958617 21720 catalog_manager.cc:4841] TS 062953e2d566492ea8645c1c370122fb (127.19.59.65:46727): tablet 233a39ed2a8447c995627b390edb04eb (table test-table [id=449e15513b3e49b59b0c39207e4ee056]) successfully deleted
I20260812 00:05:19.959631 22420 ts_tablet_manager.cc:1918] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:05:19.959683 22420 log.cc:1196] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/233a39ed2a8447c995627b390edb04eb
I20260812 00:05:19.959895 22420 ts_tablet_manager.cc:1939] T 233a39ed2a8447c995627b390edb04eb P 307f6b1c467a4d33b13d093da040aa47: Deleting consensus metadata
I20260812 00:05:19.960204 21721 catalog_manager.cc:4841] TS 307f6b1c467a4d33b13d093da040aa47 (127.19.59.66:42719): tablet 233a39ed2a8447c995627b390edb04eb (table test-table [id=449e15513b3e49b59b0c39207e4ee056]) successfully deleted
Aug 12 00:05:19 dist-test-slave-6nmv krb5kdc[21689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493119, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:05:19 dist-test-slave-6nmv krb5kdc[21689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493119, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:19.978322 22430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:19.971090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45602 (local address 127.19.59.126:45959)
0812 00:05:19.971244 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:19.971245 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:19.971276 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:05:19.971351 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:19.971351 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:19.971361 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:19.971425 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:19.972070 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:19.972658 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:19.973410 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:19.973604 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:19.973653 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:19.975825 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:19.975827 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:19.975827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:19.975833 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:19.977276 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:19.977574 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:19.977574 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:19.977575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:19.977644 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:19.977798 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:19.977799 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:19.977799 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:19.977947 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:19.978024 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:19.978114 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 00:05:19.978178 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":107,"threads_started":1}
I20260812 00:05:19.979733 21738 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45602:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:19.979887 21738 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:19.981091 21895 tablet_service.cc:1467] Processing CreateTablet for tablet f7ee2de0ce334a12bcfd7eb57efb2f7b (DEFAULT_TABLE table=test-table [id=c4920d35f9e7470485ace823b683558b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:19.981122 22221 tablet_service.cc:1467] Processing CreateTablet for tablet f7ee2de0ce334a12bcfd7eb57efb2f7b (DEFAULT_TABLE table=test-table [id=c4920d35f9e7470485ace823b683558b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:19.981102 22045 tablet_service.cc:1467] Processing CreateTablet for tablet f7ee2de0ce334a12bcfd7eb57efb2f7b (DEFAULT_TABLE table=test-table [id=c4920d35f9e7470485ace823b683558b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:19.981225 21895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ee2de0ce334a12bcfd7eb57efb2f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:19.981230 22221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ee2de0ce334a12bcfd7eb57efb2f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:19.981241 22045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ee2de0ce334a12bcfd7eb57efb2f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:19.982553 22431 tablet_bootstrap.cc:492] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47: Bootstrap starting.
I20260812 00:05:19.982674 22432 tablet_bootstrap.cc:492] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb: Bootstrap starting.
I20260812 00:05:19.982971 22431 tablet_bootstrap.cc:654] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:19.983026 22432 tablet_bootstrap.cc:654] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:19.983283 22433 tablet_bootstrap.cc:492] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b: Bootstrap starting.
I20260812 00:05:19.983587 22432 tablet_bootstrap.cc:492] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb: No bootstrap required, opened a new log
I20260812 00:05:19.983642 22432 ts_tablet_manager.cc:1397] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:19.983693 22433 tablet_bootstrap.cc:654] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:19.983791 22432 raft_consensus.cc:348] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:19.983870 22432 raft_consensus.cc:374] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:19.983913 22432 raft_consensus.cc:729] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062953e2d566492ea8645c1c370122fb, State: Initialized, Role: FOLLOWER
I20260812 00:05:19.983999 22432 consensus_queue.cc:260] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:19.984139 22432 ts_tablet_manager.cc:1428] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:19.984365 22431 tablet_bootstrap.cc:492] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47: No bootstrap required, opened a new log
I20260812 00:05:19.984520 22433 tablet_bootstrap.cc:492] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b: No bootstrap required, opened a new log
I20260812 00:05:19.984513 22431 ts_tablet_manager.cc:1397] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:19.984655 22431 raft_consensus.cc:348] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:19.984725 22431 raft_consensus.cc:374] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:19.984720 22433 ts_tablet_manager.cc:1397] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:19.984745 22431 raft_consensus.cc:729] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 307f6b1c467a4d33b13d093da040aa47, State: Initialized, Role: FOLLOWER
I20260812 00:05:19.984802 22431 consensus_queue.cc:260] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:19.984843 22433 raft_consensus.cc:348] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:19.984911 22433 raft_consensus.cc:374] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:19.984934 22433 raft_consensus.cc:729] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e04934d4d9b4ad1b36a9123f23dfa1b, State: Initialized, Role: FOLLOWER
I20260812 00:05:19.984969 22431 ts_tablet_manager.cc:1428] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:19.985042 22433 consensus_queue.cc:260] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:19.985184 22433 ts_tablet_manager.cc:1428] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:20.288192 22410 raft_consensus.cc:482] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:20.288305 22410 raft_consensus.cc:504] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:20.288471 22410 leader_election.cc:288] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 307f6b1c467a4d33b13d093da040aa47 (127.19.59.66:42719), 4e04934d4d9b4ad1b36a9123f23dfa1b (127.19.59.67:44491)
I20260812 00:05:20.288697 22085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ee2de0ce334a12bcfd7eb57efb2f7b" candidate_uuid: "062953e2d566492ea8645c1c370122fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "307f6b1c467a4d33b13d093da040aa47" is_pre_election: true
I20260812 00:05:20.288717 22246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ee2de0ce334a12bcfd7eb57efb2f7b" candidate_uuid: "062953e2d566492ea8645c1c370122fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" is_pre_election: true
I20260812 00:05:20.288807 22085 raft_consensus.cc:2454] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062953e2d566492ea8645c1c370122fb in term 0.
I20260812 00:05:20.288805 22246 raft_consensus.cc:2454] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062953e2d566492ea8645c1c370122fb in term 0.
I20260812 00:05:20.288976 21846 leader_election.cc:302] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062953e2d566492ea8645c1c370122fb, 307f6b1c467a4d33b13d093da040aa47; no voters:
I20260812 00:05:20.289094 22410 raft_consensus.cc:2781] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:20.289139 22410 raft_consensus.cc:482] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:20.289152 22410 raft_consensus.cc:3037] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:20.289933 22410 raft_consensus.cc:504] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:20.290082 22410 leader_election.cc:288] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [CANDIDATE]: Term 1 election: Requested vote from peers 307f6b1c467a4d33b13d093da040aa47 (127.19.59.66:42719), 4e04934d4d9b4ad1b36a9123f23dfa1b (127.19.59.67:44491)
I20260812 00:05:20.290241 22085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ee2de0ce334a12bcfd7eb57efb2f7b" candidate_uuid: "062953e2d566492ea8645c1c370122fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "307f6b1c467a4d33b13d093da040aa47"
I20260812 00:05:20.290333 22085 raft_consensus.cc:3037] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:20.290310 22246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ee2de0ce334a12bcfd7eb57efb2f7b" candidate_uuid: "062953e2d566492ea8645c1c370122fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b"
I20260812 00:05:20.290418 22246 raft_consensus.cc:3037] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:20.290972 22085 raft_consensus.cc:2454] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062953e2d566492ea8645c1c370122fb in term 1.
I20260812 00:05:20.291042 22246 raft_consensus.cc:2454] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062953e2d566492ea8645c1c370122fb in term 1.
I20260812 00:05:20.291188 21846 leader_election.cc:302] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062953e2d566492ea8645c1c370122fb, 307f6b1c467a4d33b13d093da040aa47; no voters:
I20260812 00:05:20.291296 22410 raft_consensus.cc:2781] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:20.291357 22410 raft_consensus.cc:686] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [term 1 LEADER]: Becoming Leader. State: Replica: 062953e2d566492ea8645c1c370122fb, State: Running, Role: LEADER
I20260812 00:05:20.291404 22410 consensus_queue.cc:237] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:20.292150 21738 catalog_manager.cc:5495] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 062953e2d566492ea8645c1c370122fb (127.19.59.65). New cstate: current_term: 1 leader_uuid: "062953e2d566492ea8645c1c370122fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260812 00:05:20.341369 22440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:20.338808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53404 (local address 127.19.59.65:46727)
0812 00:05:20.338980 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:20.338982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:20.338989 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:20.339012 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:20.339013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:20.339021 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:20.339069 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:20.339187 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:20.339667 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:20.340507 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:20.340854 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:20.340919 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:20.341100 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:20.341137 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:20.341185 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:20.341263 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 00:05:20.341285 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":113,"threads_started":1}
I20260812 00:05:20.343505 22085 raft_consensus.cc:1261] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Refusing update from remote peer 062953e2d566492ea8645c1c370122fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:20.343518 22246 raft_consensus.cc:1261] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Refusing update from remote peer 062953e2d566492ea8645c1c370122fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:20.343737 22410 consensus_queue.cc:1035] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:20.343835 22414 consensus_queue.cc:1035] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:20.353662 21738 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:20.353775 21738 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:20.354435 21738 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec: Sending DeleteTablet for 3 replicas of tablet f7ee2de0ce334a12bcfd7eb57efb2f7b
I20260812 00:05:20.354707 22045 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ee2de0ce334a12bcfd7eb57efb2f7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:20 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:41048
I20260812 00:05:20.354712 22221 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ee2de0ce334a12bcfd7eb57efb2f7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:20 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:52568
I20260812 00:05:20.354727 21895 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ee2de0ce334a12bcfd7eb57efb2f7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:20 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:53396
I20260812 00:05:20.354800 22422 tablet_replica.cc:330] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb: stopping tablet replica
I20260812 00:05:20.354802 22420 tablet_replica.cc:330] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47: stopping tablet replica
I20260812 00:05:20.354852 22422 raft_consensus.cc:2229] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:20.354856 22420 raft_consensus.cc:2229] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:20.354895 22420 raft_consensus.cc:2258] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:20.354904 22422 raft_consensus.cc:2258] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:20.354985 22421 tablet_replica.cc:330] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b: stopping tablet replica
I20260812 00:05:20.355043 22421 raft_consensus.cc:2229] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:20.355078 22421 raft_consensus.cc:2258] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:20.355161 22420 ts_tablet_manager.cc:1905] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:20.355238 21738 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45602:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:20.355365 21738 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:20.355388 22422 ts_tablet_manager.cc:1905] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:20.356593 21895 tablet_service.cc:1467] Processing CreateTablet for tablet 52fab5b066294ae18c865ea5cb8b80b0 (DEFAULT_TABLE table=test-table [id=15fc2fca27764480a574a7327855a11c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:20.356696 21895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52fab5b066294ae18c865ea5cb8b80b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:20.356870 22420 ts_tablet_manager.cc:1918] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:05:20.356915 22420 log.cc:1196] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/f7ee2de0ce334a12bcfd7eb57efb2f7b
I20260812 00:05:20.357075 22422 ts_tablet_manager.cc:1918] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:05:20.357115 22422 log.cc:1196] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-0/wal/wals/f7ee2de0ce334a12bcfd7eb57efb2f7b
I20260812 00:05:20.357139 22420 ts_tablet_manager.cc:1939] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 307f6b1c467a4d33b13d093da040aa47: Deleting consensus metadata
I20260812 00:05:20.357297 22422 ts_tablet_manager.cc:1939] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 062953e2d566492ea8645c1c370122fb: Deleting consensus metadata
I20260812 00:05:20.357486 21721 catalog_manager.cc:4841] TS 307f6b1c467a4d33b13d093da040aa47 (127.19.59.66:42719): tablet f7ee2de0ce334a12bcfd7eb57efb2f7b (table test-table [id=c4920d35f9e7470485ace823b683558b]) successfully deleted
I20260812 00:05:20.357573 22045 tablet_service.cc:1467] Processing CreateTablet for tablet 52fab5b066294ae18c865ea5cb8b80b0 (DEFAULT_TABLE table=test-table [id=15fc2fca27764480a574a7327855a11c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:20.357587 22221 tablet_service.cc:1467] Processing CreateTablet for tablet 52fab5b066294ae18c865ea5cb8b80b0 (DEFAULT_TABLE table=test-table [id=15fc2fca27764480a574a7327855a11c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:20.357664 22045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52fab5b066294ae18c865ea5cb8b80b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:20.357671 22221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52fab5b066294ae18c865ea5cb8b80b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:20.358047 22432 tablet_bootstrap.cc:492] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb: Bootstrap starting.
I20260812 00:05:20.358325 22432 tablet_bootstrap.cc:654] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:20.358805 22431 tablet_bootstrap.cc:492] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47: Bootstrap starting.
I20260812 00:05:20.359112 22431 tablet_bootstrap.cc:654] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:20.359143 22433 tablet_bootstrap.cc:492] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b: Bootstrap starting.
I20260812 00:05:20.359237 22421 ts_tablet_manager.cc:1905] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:20.359390 22433 tablet_bootstrap.cc:654] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:20.359442 22432 tablet_bootstrap.cc:492] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb: No bootstrap required, opened a new log
I20260812 00:05:20.359490 22432 ts_tablet_manager.cc:1397] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:20.359606 22432 raft_consensus.cc:348] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:20.359661 22432 raft_consensus.cc:374] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:20.359678 22432 raft_consensus.cc:729] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062953e2d566492ea8645c1c370122fb, State: Initialized, Role: FOLLOWER
I20260812 00:05:20.359727 22432 consensus_queue.cc:260] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:20.359823 22432 ts_tablet_manager.cc:1428] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:20.360337 22433 tablet_bootstrap.cc:492] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b: No bootstrap required, opened a new log
I20260812 00:05:20.360384 22433 ts_tablet_manager.cc:1397] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260812 00:05:20.360486 22433 raft_consensus.cc:348] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:20.360553 22433 raft_consensus.cc:374] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:20.360572 22433 raft_consensus.cc:729] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e04934d4d9b4ad1b36a9123f23dfa1b, State: Initialized, Role: FOLLOWER
I20260812 00:05:20.360615 22433 consensus_queue.cc:260] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:20.360707 22433 ts_tablet_manager.cc:1428] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:20.360930 22421 ts_tablet_manager.cc:1918] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:05:20.361033 22421 log.cc:1196] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/f7ee2de0ce334a12bcfd7eb57efb2f7b
I20260812 00:05:20.361238 22421 ts_tablet_manager.cc:1939] T f7ee2de0ce334a12bcfd7eb57efb2f7b P 4e04934d4d9b4ad1b36a9123f23dfa1b: Deleting consensus metadata
I20260812 00:05:20.361524 21723 catalog_manager.cc:4841] TS 4e04934d4d9b4ad1b36a9123f23dfa1b (127.19.59.67:44491): tablet f7ee2de0ce334a12bcfd7eb57efb2f7b (table test-table [id=c4920d35f9e7470485ace823b683558b]) successfully deleted
I20260812 00:05:20.361642 21720 catalog_manager.cc:4841] TS 062953e2d566492ea8645c1c370122fb (127.19.59.65:46727): tablet f7ee2de0ce334a12bcfd7eb57efb2f7b (table test-table [id=c4920d35f9e7470485ace823b683558b]) successfully deleted
I20260812 00:05:20.361938 22431 tablet_bootstrap.cc:492] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47: No bootstrap required, opened a new log
I20260812 00:05:20.361981 22431 ts_tablet_manager.cc:1397] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20260812 00:05:20.362121 22431 raft_consensus.cc:348] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:20.362174 22431 raft_consensus.cc:374] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:20.362216 22431 raft_consensus.cc:729] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 307f6b1c467a4d33b13d093da040aa47, State: Initialized, Role: FOLLOWER
I20260812 00:05:20.362268 22431 consensus_queue.cc:260] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:20.362360 22431 ts_tablet_manager.cc:1428] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:20.382709 22400 raft_consensus.cc:482] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:20.382804 22400 raft_consensus.cc:504] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:20.382978 22400 leader_election.cc:288] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 062953e2d566492ea8645c1c370122fb (127.19.59.65:46727), 307f6b1c467a4d33b13d093da040aa47 (127.19.59.66:42719)
I20260812 00:05:20.383188 21929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52fab5b066294ae18c865ea5cb8b80b0" candidate_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062953e2d566492ea8645c1c370122fb" is_pre_election: true
I20260812 00:05:20.383172 22085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52fab5b066294ae18c865ea5cb8b80b0" candidate_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "307f6b1c467a4d33b13d093da040aa47" is_pre_election: true
I20260812 00:05:20.383272 22085 raft_consensus.cc:2454] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e04934d4d9b4ad1b36a9123f23dfa1b in term 0.
I20260812 00:05:20.383272 21929 raft_consensus.cc:2454] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e04934d4d9b4ad1b36a9123f23dfa1b in term 0.
I20260812 00:05:20.383424 22165 leader_election.cc:302] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 307f6b1c467a4d33b13d093da040aa47, 4e04934d4d9b4ad1b36a9123f23dfa1b; no voters:
I20260812 00:05:20.383553 22400 raft_consensus.cc:2781] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:20.383601 22400 raft_consensus.cc:482] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:20.383628 22400 raft_consensus.cc:3037] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:20.384281 22400 raft_consensus.cc:504] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:20.384478 22400 leader_election.cc:288] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [CANDIDATE]: Term 1 election: Requested vote from peers 062953e2d566492ea8645c1c370122fb (127.19.59.65:46727), 307f6b1c467a4d33b13d093da040aa47 (127.19.59.66:42719)
I20260812 00:05:20.384610 21929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52fab5b066294ae18c865ea5cb8b80b0" candidate_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062953e2d566492ea8645c1c370122fb"
I20260812 00:05:20.384650 22085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52fab5b066294ae18c865ea5cb8b80b0" candidate_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "307f6b1c467a4d33b13d093da040aa47"
I20260812 00:05:20.384692 21929 raft_consensus.cc:3037] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:20.384709 22085 raft_consensus.cc:3037] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:20.385406 22085 raft_consensus.cc:2454] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e04934d4d9b4ad1b36a9123f23dfa1b in term 1.
I20260812 00:05:20.385406 21929 raft_consensus.cc:2454] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e04934d4d9b4ad1b36a9123f23dfa1b in term 1.
I20260812 00:05:20.385603 22164 leader_election.cc:302] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062953e2d566492ea8645c1c370122fb, 4e04934d4d9b4ad1b36a9123f23dfa1b; no voters:
I20260812 00:05:20.385726 22400 raft_consensus.cc:2781] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:20.385777 22400 raft_consensus.cc:686] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 LEADER]: Becoming Leader. State: Replica: 4e04934d4d9b4ad1b36a9123f23dfa1b, State: Running, Role: LEADER
I20260812 00:05:20.385847 22400 consensus_queue.cc:237] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } }
I20260812 00:05:20.386410 21737 catalog_manager.cc:5495] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e04934d4d9b4ad1b36a9123f23dfa1b (127.19.59.67). New cstate: current_term: 1 leader_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e04934d4d9b4ad1b36a9123f23dfa1b" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44491 } health_report { overall_health: HEALTHY } } }
I20260812 00:05:20.398054 22448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:20.395590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52592 (local address 127.19.59.67:44491)
0812 00:05:20.395755 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:20.395757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:20.395763 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:05:20.395794 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:20.395794 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:20.395803 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:20.395884 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:20.395987 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:20.396547 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:20.397315 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:20.397514 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:20.397587 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:20.397741 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:20.397775 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:20.397865 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:20.397926 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 00:05:20.397972 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":101,"threads_started":1}
I20260812 00:05:20.402330 22448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:20.400345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:48511 (local address 127.19.59.67:44491)
0812 00:05:20.400394 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:20.400396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:20.400451 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:05:20.400517 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:20.400518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:20.400525 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:20.400562 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:20.400660 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:20.401065 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:20.401750 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:20.401976 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:20.402027 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:20.402150 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:20.402172 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:20.402206 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:20.402243 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 00:05:20.402259 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:05:20.402375 22453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:20.400197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:44491 (local address 127.19.59.67:48511)
0812 00:05:20.400371 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:20.400383 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:20.400469 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:20.400578 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:20.400579 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:20.400581 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:05:20.400616 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:20.400617 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:20.401127 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:20.401128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:20.401656 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:20.401657 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:20.402044 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:20.402045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:20.402086 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:20.402090 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:05:20.402211 (+ 121us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:05:20.402212 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 00:05:20.402241 (+ 29us) client_negotiation.cc:240] Negotiation successful
0812 00:05:20.402271 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":80,"threads_started":1}
I20260812 00:05:20.404142 21929 raft_consensus.cc:1261] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Refusing update from remote peer 4e04934d4d9b4ad1b36a9123f23dfa1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:20.404165 22085 raft_consensus.cc:1261] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Refusing update from remote peer 4e04934d4d9b4ad1b36a9123f23dfa1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:20.404354 22327 consensus_queue.cc:1035] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "307f6b1c467a4d33b13d093da040aa47" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:20.404457 22405 consensus_queue.cc:1035] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "062953e2d566492ea8645c1c370122fb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:05:20.408752 22398 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 00:05:21.929874 21738 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:21.930013 21738 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:21.930946 21738 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1c4937835eb149eb9421af015af560ec: Sending DeleteTablet for 3 replicas of tablet 52fab5b066294ae18c865ea5cb8b80b0
I20260812 00:05:21.931208 22045 tablet_service.cc:1514] Processing DeleteTablet for tablet 52fab5b066294ae18c865ea5cb8b80b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:21 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:41048
I20260812 00:05:21.931224 21895 tablet_service.cc:1514] Processing DeleteTablet for tablet 52fab5b066294ae18c865ea5cb8b80b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:21 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:53396
I20260812 00:05:21.931213 22220 tablet_service.cc:1514] Processing DeleteTablet for tablet 52fab5b066294ae18c865ea5cb8b80b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:21 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:52568
I20260812 00:05:21.931481 22483 tablet_replica.cc:330] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b: stopping tablet replica
I20260812 00:05:21.931510 22481 tablet_replica.cc:330] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb: stopping tablet replica
I20260812 00:05:21.931550 22483 raft_consensus.cc:2229] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:21.931592 22481 raft_consensus.cc:2229] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:21.931648 22481 raft_consensus.cc:2258] T 52fab5b066294ae18c865ea5cb8b80b0 P 062953e2d566492ea8645c1c370122fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:21.931648 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 21824
I20260812 00:05:21.937119 22483 raft_consensus.cc:2258] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:21.937419 22483 ts_tablet_manager.cc:1905] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:21.939100 22483 ts_tablet_manager.cc:1918] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:05:21.939199 22483 log.cc:1196] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/52fab5b066294ae18c865ea5cb8b80b0
I20260812 00:05:21.939471 22483 ts_tablet_manager.cc:1939] T 52fab5b066294ae18c865ea5cb8b80b0 P 4e04934d4d9b4ad1b36a9123f23dfa1b: Deleting consensus metadata
I20260812 00:05:21.939841 21723 catalog_manager.cc:4841] TS 4e04934d4d9b4ad1b36a9123f23dfa1b (127.19.59.67:44491): tablet 52fab5b066294ae18c865ea5cb8b80b0 (table test-table [id=15fc2fca27764480a574a7327855a11c]) successfully deleted
I20260812 00:05:21.942304 22482 tablet_replica.cc:330] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47: stopping tablet replica
I20260812 00:05:21.942386 22482 raft_consensus.cc:2229] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:21.942441 22482 raft_consensus.cc:2258] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:21.945923 22482 ts_tablet_manager.cc:1905] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:21.947952 22482 ts_tablet_manager.cc:1918] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:05:21.948025 22482 log.cc:1196] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/52fab5b066294ae18c865ea5cb8b80b0
I20260812 00:05:21.948251 22482 ts_tablet_manager.cc:1939] T 52fab5b066294ae18c865ea5cb8b80b0 P 307f6b1c467a4d33b13d093da040aa47: Deleting consensus metadata
I20260812 00:05:21.948632 21721 catalog_manager.cc:4841] TS 307f6b1c467a4d33b13d093da040aa47 (127.19.59.66:42719): tablet 52fab5b066294ae18c865ea5cb8b80b0 (table test-table [id=15fc2fca27764480a574a7327855a11c]) successfully deleted
W20260812 00:05:21.950182 21720 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:46727 (error 108)
I20260812 00:05:21.950397 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 21990
I20260812 00:05:21.953197 22485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:21.952952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46727 (local address 127.0.0.1:53420)
0812 00:05:21.953098 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:21.953160 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:46727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
W20260812 00:05:21.953361 21720 catalog_manager.cc:4584] TS 062953e2d566492ea8645c1c370122fb (127.19.59.65:46727): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 52fab5b066294ae18c865ea5cb8b80b0: Network error: Client connection negotiation failed: client connection to 127.19.59.65:46727: connect: Connection refused (error 111)
I20260812 00:05:21.958801 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 22145
I20260812 00:05:21.968207 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 21703
2026-08-12T00:05:21Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5796 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:22 dist-test-slave-6nmv krb5kdc[22489](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:22 dist-test-slave-6nmv krb5kdc[22489](info): set up 2 sockets
Aug 12 00:05:22 dist-test-slave-6nmv krb5kdc[22489](info): commencing operation
krb5kdc: starting...
W20260812 00:05:23.039764 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:05:23 dist-test-slave-6nmv krb5kdc[22489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:05:23.146752 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:33043
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:33043
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:23.220453 22503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:23.220641 22503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:23.220671 22503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:23.221648 22503 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:23.221704 22503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:23.221724 22503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:23.221742 22503 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:23.221766 22503 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:23.223203 22503 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:33043
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:33043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22503
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:23.223430 22503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:23.223626 22503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:23.227833 22511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:23.227860 22513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:23.227918 22503 server_base.cc:1034] running on GCE node
W20260812 00:05:23.227816 22510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:23.228278 22503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:23.228554 22503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:23.229703 22503 hybrid_clock.cc:648] HybridClock initialized: now 1786493123229678 us; error 45 us; skew 500 ppm
Aug 12 00:05:23 dist-test-slave-6nmv krb5kdc[22489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493123, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:23.231894 22503 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:05:23.232326 22503 webserver.cc:460] Webserver started at http://127.19.59.126:35203/ using document root <none> and password file <none>
I20260812 00:05:23.232542 22503 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:23.232611 22503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:23.232753 22503 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:23.233650 22503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "49910f17f4764a37a3f1620d4635fb2c"
format_stamp: "Formatted at 2026-08-12 00:05:23 on dist-test-slave-6nmv"
server_key: "696e1d6de374fa3e428c5169a04b3f89"
server_key_iv: "b0631cce2e4663d0eca2a2417534fcd9"
server_key_version: "encryptionkey@0"
I20260812 00:05:23.233989 22503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "49910f17f4764a37a3f1620d4635fb2c"
format_stamp: "Formatted at 2026-08-12 00:05:23 on dist-test-slave-6nmv"
server_key: "696e1d6de374fa3e428c5169a04b3f89"
server_key_iv: "b0631cce2e4663d0eca2a2417534fcd9"
server_key_version: "encryptionkey@0"
I20260812 00:05:23.235195 22503 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:23.235831 22523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:23.236056 22503 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:23.236157 22503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "49910f17f4764a37a3f1620d4635fb2c"
format_stamp: "Formatted at 2026-08-12 00:05:23 on dist-test-slave-6nmv"
server_key: "696e1d6de374fa3e428c5169a04b3f89"
server_key_iv: "b0631cce2e4663d0eca2a2417534fcd9"
server_key_version: "encryptionkey@0"
I20260812 00:05:23.236236 22503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:23.248524 22503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:23.250295 22503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:23.250461 22503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:23.254439 22503 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:33043
I20260812 00:05:23.254498 22583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:33043 every 8 connection(s)
I20260812 00:05:23.254827 22503 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:23.255643 22584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:23.257501 22584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c: Bootstrap starting.
I20260812 00:05:23.258056 22584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:23.258311 22584 log.cc:824] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:23.258934 22584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c: No bootstrap required, opened a new log
I20260812 00:05:23.260265 22584 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49910f17f4764a37a3f1620d4635fb2c" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33043 } }
I20260812 00:05:23.260397 22584 raft_consensus.cc:374] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:23.260419 22584 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49910f17f4764a37a3f1620d4635fb2c, State: Initialized, Role: FOLLOWER
I20260812 00:05:23.260571 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 22503
I20260812 00:05:23.260572 22584 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49910f17f4764a37a3f1620d4635fb2c" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33043 } }
I20260812 00:05:23.260659 22584 raft_consensus.cc:388] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:23.260664 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:23.260699 22584 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:23.260737 22584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:23.260844 19693 external_mini_cluster.cc:1428] Setting key 43443747c95ed01468a67b438a6115a3
I20260812 00:05:23.261406 22584 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49910f17f4764a37a3f1620d4635fb2c" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33043 } }
I20260812 00:05:23.261556 22584 leader_election.cc:302] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49910f17f4764a37a3f1620d4635fb2c; no voters:
I20260812 00:05:23.261703 22584 leader_election.cc:288] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:23.261729 22589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:23.261937 22589 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [term 1 LEADER]: Becoming Leader. State: Replica: 49910f17f4764a37a3f1620d4635fb2c, State: Running, Role: LEADER
I20260812 00:05:23.261986 22584 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:23.262107 22589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49910f17f4764a37a3f1620d4635fb2c" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33043 } }
I20260812 00:05:23.262754 22590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49910f17f4764a37a3f1620d4635fb2c. Latest consensus state: current_term: 1 leader_uuid: "49910f17f4764a37a3f1620d4635fb2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49910f17f4764a37a3f1620d4635fb2c" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33043 } } }
I20260812 00:05:23.262768 22591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49910f17f4764a37a3f1620d4635fb2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49910f17f4764a37a3f1620d4635fb2c" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33043 } } }
I20260812 00:05:23.262858 22590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:23.262874 22591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:23.263082 22598 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:23.263538 22598 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:23.265707 22598 catalog_manager.cc:1347] Generated new cluster ID: bc1408ac72834226be03411283ec626e
I20260812 00:05:23.265766 22598 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:05:23 dist-test-slave-6nmv krb5kdc[22489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:23.271780 22588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:23.261562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45792 (local address 127.19.59.126:33043)
0812 00:05:23.261719 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:23.261727 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:23.261758 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:05:23.261896 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:23.261907 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:23.261981 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:23.262876 (+ 895us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:23.262984 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:23.264218 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:23.265138 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:23.265551 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:23.265619 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:23.268184 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:23.268188 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:23.268188 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:23.268199 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:23.270105 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:23.270470 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:23.270473 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:23.270474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:23.270590 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:23.270779 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:23.270780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:23.270780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:23.271068 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:23.271221 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:23.271308 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 00:05:23.271570 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":85,"threads_started":1}
I20260812 00:05:23.278088 22598 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:23.278578 22598 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:23.281595 22598 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 49910f17f4764a37a3f1620d4635fb2c: Generated new TSK 0
I20260812 00:05:23.281749 22598 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:05:23.312726 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:33043
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:23.387921 22612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:23.388092 22612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:23.388113 22612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:23.389142 22612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:23.389178 22612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:23.389202 22612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:05:23.390494 22612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:33043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:23.390707 22612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:23.390905 22612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:23.395601 22621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:23.395607 22617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:23.395617 22618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:23.395865 22612 server_base.cc:1034] running on GCE node
I20260812 00:05:23.396205 22612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:23.396451 22612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:23.397619 22612 hybrid_clock.cc:648] HybridClock initialized: now 1786493123397607 us; error 42 us; skew 500 ppm
Aug 12 00:05:23 dist-test-slave-6nmv krb5kdc[22489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493123, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:23.400019 22612 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:05:23.400429 22612 webserver.cc:460] Webserver started at http://127.19.59.65:45205/ using document root <none> and password file <none>
I20260812 00:05:23.400619 22612 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:23.400658 22612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:23.400772 22612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:23.401628 22612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "28d6b02c650545009616cf935664ed48"
format_stamp: "Formatted at 2026-08-12 00:05:23 on dist-test-slave-6nmv"
server_key: "24d66847613828be0068cc0a08830c65"
server_key_iv: "529f33b10b383623c78e1350bcd4b5ec"
server_key_version: "encryptionkey@0"
I20260812 00:05:23.401984 22612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "28d6b02c650545009616cf935664ed48"
format_stamp: "Formatted at 2026-08-12 00:05:23 on dist-test-slave-6nmv"
server_key: "24d66847613828be0068cc0a08830c65"
server_key_iv: "529f33b10b383623c78e1350bcd4b5ec"
server_key_version: "encryptionkey@0"
I20260812 00:05:23.403379 22612 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:23.404026 22630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:23.404170 22612 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:23.404251 22612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "28d6b02c650545009616cf935664ed48"
format_stamp: "Formatted at 2026-08-12 00:05:23 on dist-test-slave-6nmv"
server_key: "24d66847613828be0068cc0a08830c65"
server_key_iv: "529f33b10b383623c78e1350bcd4b5ec"
server_key_version: "encryptionkey@0"
I20260812 00:05:23.404321 22612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:23.425894 22612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:23.428088 22612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:23.428198 22612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:23.428362 22612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:23.428603 22612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:23.428649 22612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:23.428669 22612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:23.428682 22612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:23.434927 22612 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:45399
I20260812 00:05:23.434986 22761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:45399 every 8 connection(s)
I20260812 00:05:23.435288 22612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:05:23.437109 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 22612
I20260812 00:05:23.437202 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:23.437374 19693 external_mini_cluster.cc:1428] Setting key 0efc426d4b1202942a42e62022a9264f
Aug 12 00:05:23 dist-test-slave-6nmv krb5kdc[22489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493123, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:23.445291 22764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:23.435922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33043 (local address 127.19.59.65:48309)
0812 00:05:23.436092 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:23.436127 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:23.436559 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:23.436762 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:23.436765 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:23.437348 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:23.437569 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:23.437574 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:23.438397 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:23.438398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:23.439618 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:23.439622 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:23.440112 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:23.440113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:23.440210 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:23.440672 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:23.440681 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:23.442167 (+ 1486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:23.444044 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:23.444050 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:23.444051 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:23.444240 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:23.444472 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:23.444472 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:23.444473 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:23.444565 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:23.444853 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:23.444857 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:23.444974 (+ 117us) client_negotiation.cc:769] Sending connection context
0812 00:05:23.445045 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 00:05:23.445150 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":99,"threads_started":1}
I20260812 00:05:23.445312 22588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:23.435956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:48309 (local address 127.19.59.126:33043)
0812 00:05:23.436016 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:23.436018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:23.436212 (+ 194us) server_negotiation.cc:407] Connection header received
0812 00:05:23.436636 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:23.436636 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:23.436648 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:23.436697 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:23.437671 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:23.438299 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:23.439730 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:23.440000 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:23.440036 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:23.442245 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:23.442247 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:23.442248 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:23.442257 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:23.443962 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:23.444315 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:23.444317 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:23.444317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:23.444393 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:23.444630 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:23.444631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:23.444631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:23.444778 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:23.444853 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:23.445098 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 00:05:23.445204 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 00:05:23.445894 22762 heartbeater.cc:347] Connected to a master server at 127.19.59.126:33043
I20260812 00:05:23.446004 22762 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:23.446164 22762 heartbeater.cc:511] Master 127.19.59.126:33043 requested a full tablet report, sending...
I20260812 00:05:23.446791 22543 ts_manager.cc:194] Registered new tserver with Master: 28d6b02c650545009616cf935664ed48 (127.19.59.65:45399)
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
I20260812 00:05:23.447715 22543 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:48309
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:05:23.462685 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:33043
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:23.541638 22767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:23.541831 22767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:23.541852 22767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:23.542927 22767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:23.542963 22767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:23.542989 22767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:05:23.544275 22767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:33043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:23.544437 22767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:23.544589 22767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:23.549343 22775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:23.549341 22773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:23.549345 22777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:23.549587 22767 server_base.cc:1034] running on GCE node
I20260812 00:05:23.549916 22767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:23.550155 22767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:23.551287 22767 hybrid_clock.cc:648] HybridClock initialized: now 1786493123551278 us; error 28 us; skew 500 ppm
Aug 12 00:05:23 dist-test-slave-6nmv krb5kdc[22489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493123, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:23.553726 22767 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:05:23.554144 22767 webserver.cc:460] Webserver started at http://127.19.59.66:37935/ using document root <none> and password file <none>
I20260812 00:05:23.554368 22767 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:23.554410 22767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:23.554580 22767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:23.555614 22767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "1fbcbd11ae0541638ce45120e8a7a562"
format_stamp: "Formatted at 2026-08-12 00:05:23 on dist-test-slave-6nmv"
server_key: "a69e04f0026d012e37c7c4001c39558f"
server_key_iv: "4f639abf5d880232bb6f7c04b08f9e88"
server_key_version: "encryptionkey@0"
I20260812 00:05:23.555970 22767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "1fbcbd11ae0541638ce45120e8a7a562"
format_stamp: "Formatted at 2026-08-12 00:05:23 on dist-test-slave-6nmv"
server_key: "a69e04f0026d012e37c7c4001c39558f"
server_key_iv: "4f639abf5d880232bb6f7c04b08f9e88"
server_key_version: "encryptionkey@0"
I20260812 00:05:23.557298 22767 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:05:23.558053 22785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:23.558238 22767 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:23.558300 22767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "1fbcbd11ae0541638ce45120e8a7a562"
format_stamp: "Formatted at 2026-08-12 00:05:23 on dist-test-slave-6nmv"
server_key: "a69e04f0026d012e37c7c4001c39558f"
server_key_iv: "4f639abf5d880232bb6f7c04b08f9e88"
server_key_version: "encryptionkey@0"
I20260812 00:05:23.558387 22767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:23.576363 22767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:23.578122 22767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:23.578275 22767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:23.578500 22767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:23.578799 22767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:23.578830 22767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:23.578850 22767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:23.578889 22767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:23.584395 22767 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:45067
I20260812 00:05:23.584445 22923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:45067 every 8 connection(s)
I20260812 00:05:23.584726 22767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:23.587281 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 22767
I20260812 00:05:23.587391 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:23.587571 19693 external_mini_cluster.cc:1428] Setting key 8cb42eda28472b041dedee2a36137fa5
Aug 12 00:05:23 dist-test-slave-6nmv krb5kdc[22489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493123, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:23.593850 22588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:23.585372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:40705 (local address 127.19.59.126:33043)
0812 00:05:23.585463 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:23.585465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:23.585624 (+ 159us) server_negotiation.cc:407] Connection header received
0812 00:05:23.586101 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:23.586102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:23.586114 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:23.586169 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:23.586966 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:23.587539 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:23.588611 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:23.588799 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:23.588874 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:23.590865 (+ 1991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:23.590866 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:23.590866 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:23.590873 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:23.592338 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:23.592867 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:23.592868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:23.592868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:23.592923 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:23.593228 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:23.593228 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:23.593228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:23.593316 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:23.593361 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:23.593682 (+ 321us) server_negotiation.cc:299] Negotiation successful
0812 00:05:23.593746 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:05:23.594069 22926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:23.585326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33043 (local address 127.19.59.66:40705)
0812 00:05:23.585508 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:23.585549 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:23.586007 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:23.586226 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:23.586230 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:23.586716 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:23.586868 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:23.586872 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:23.587628 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:23.587629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:23.588532 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:23.588535 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:23.588884 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:23.588885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:23.589000 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:23.589416 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:23.589423 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:23.590778 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:23.592460 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:23.592467 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:23.592469 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:23.592790 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:23.592991 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:23.592992 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:23.592992 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:23.593151 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:23.593374 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:23.593379 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:23.593535 (+ 156us) client_negotiation.cc:769] Sending connection context
0812 00:05:23.593666 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 00:05:23.593863 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":82,"threads_started":1}
I20260812 00:05:23.594628 22924 heartbeater.cc:347] Connected to a master server at 127.19.59.126:33043
I20260812 00:05:23.594734 22924 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:23.594895 22924 heartbeater.cc:511] Master 127.19.59.126:33043 requested a full tablet report, sending...
I20260812 00:05:23.595250 22543 ts_manager.cc:194] Registered new tserver with Master: 1fbcbd11ae0541638ce45120e8a7a562 (127.19.59.66:45067)
I20260812 00:05:23.595649 22543 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:40705
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:05:23.612285 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:33043
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:23.687968 22929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:23.688164 22929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:23.688197 22929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:23.689186 22929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:23.689244 22929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:23.689283 22929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:05:23.690559 22929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:33043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:23.690785 22929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:23.690985 22929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:23.695626 22938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:23.695741 22929 server_base.cc:1034] running on GCE node
W20260812 00:05:23.695639 22947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:23.695640 22937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:23.696040 22929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:23.696281 22929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:23.697410 22929 hybrid_clock.cc:648] HybridClock initialized: now 1786493123697402 us; error 26 us; skew 500 ppm
Aug 12 00:05:23 dist-test-slave-6nmv krb5kdc[22489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493123, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:23.699793 22929 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:05:23.700193 22929 webserver.cc:460] Webserver started at http://127.19.59.67:34543/ using document root <none> and password file <none>
I20260812 00:05:23.700381 22929 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:23.700438 22929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:23.700569 22929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:23.701403 22929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "aac2db6f611f4eb49d0bbf172330e0d8"
format_stamp: "Formatted at 2026-08-12 00:05:23 on dist-test-slave-6nmv"
server_key: "7e9d9c297f19b6be19d3bb94e12827e6"
server_key_iv: "870d126d5b031952a3e9a57a28f3395a"
server_key_version: "encryptionkey@0"
I20260812 00:05:23.701776 22929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "aac2db6f611f4eb49d0bbf172330e0d8"
format_stamp: "Formatted at 2026-08-12 00:05:23 on dist-test-slave-6nmv"
server_key: "7e9d9c297f19b6be19d3bb94e12827e6"
server_key_iv: "870d126d5b031952a3e9a57a28f3395a"
server_key_version: "encryptionkey@0"
I20260812 00:05:23.703140 22929 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:23.703838 22956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:23.703989 22929 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:23.704072 22929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "aac2db6f611f4eb49d0bbf172330e0d8"
format_stamp: "Formatted at 2026-08-12 00:05:23 on dist-test-slave-6nmv"
server_key: "7e9d9c297f19b6be19d3bb94e12827e6"
server_key_iv: "870d126d5b031952a3e9a57a28f3395a"
server_key_version: "encryptionkey@0"
I20260812 00:05:23.704141 22929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:23.716255 22929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:23.718276 22929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:23.718418 22929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:23.718633 22929 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:23.718917 22929 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:23.718969 22929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:23.719004 22929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:23.719030 22929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:23.724496 22929 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:38931
I20260812 00:05:23.724536 23092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:38931 every 8 connection(s)
I20260812 00:05:23.724799 22929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:23.726245 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 22929
I20260812 00:05:23.726339 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:23.726557 19693 external_mini_cluster.cc:1428] Setting key 54b7b60355339c9433f991becb020dcc
Aug 12 00:05:23 dist-test-slave-6nmv krb5kdc[22489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493123, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:23.732859 22588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:23.725361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:34761 (local address 127.19.59.126:33043)
0812 00:05:23.725402 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:23.725404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:23.725651 (+ 247us) server_negotiation.cc:407] Connection header received
0812 00:05:23.726252 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:23.726253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:23.726263 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:23.726324 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:23.727340 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:23.727766 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:23.728602 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:23.728759 (+ 157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:23.728807 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:23.730520 (+ 1713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:23.730521 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:23.730521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:23.730527 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:23.731785 (+ 1258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:23.732138 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:23.732138 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:23.732139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:23.732191 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:23.732397 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:23.732397 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:23.732398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:23.732502 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:23.732552 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:23.732743 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 00:05:23.732800 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:05:23.733075 23096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:23.725338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33043 (local address 127.19.59.67:34761)
0812 00:05:23.725495 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:23.725522 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:23.726140 (+ 618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:23.726388 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:23.726392 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:23.727033 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:23.727269 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:23.727275 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:23.727833 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:23.727834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:23.728534 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:23.728537 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:23.728825 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:23.728825 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:23.728910 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:23.729274 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:23.729281 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:23.730443 (+ 1162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:23.731848 (+ 1405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:23.731852 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:23.731854 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:23.732075 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:23.732247 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:23.732248 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:23.732248 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:23.732344 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:23.732556 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:23.732560 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:23.732659 (+ 99us) client_negotiation.cc:769] Sending connection context
0812 00:05:23.732731 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 00:05:23.732836 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":107,"threads_started":1}
I20260812 00:05:23.733567 23093 heartbeater.cc:347] Connected to a master server at 127.19.59.126:33043
I20260812 00:05:23.733649 23093 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:23.733760 23093 heartbeater.cc:511] Master 127.19.59.126:33043 requested a full tablet report, sending...
I20260812 00:05:23.734102 22543 ts_manager.cc:194] Registered new tserver with Master: aac2db6f611f4eb49d0bbf172330e0d8 (127.19.59.67:38931)
I20260812 00:05:23.734421 22543 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:34761
I20260812 00:05:23.738626 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 00:05:23.750020 22588 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:23.749221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45798 (local address 127.19.59.126:33043)
0812 00:05:23.749273 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:23.749275 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:23.749329 (+ 54us) server_negotiation.cc:407] Connection header received
0812 00:05:23.749389 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:23.749406 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:23.749425 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:23.749476 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:23.749974 (+ 498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45798: BlockingRecv error: recv got EOF from 127.0.0.1:45798 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:05:23.750927 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 22612
I20260812 00:05:23.761222 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 22767
I20260812 00:05:23.767838 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 22929
I20260812 00:05:23.778847 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 22503
2026-08-12T00:05:23Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1808 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:23 dist-test-slave-6nmv krb5kdc[23108](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:23 dist-test-slave-6nmv krb5kdc[23108](info): set up 2 sockets
Aug 12 00:05:23 dist-test-slave-6nmv krb5kdc[23108](info): commencing operation
krb5kdc: starting...
W20260812 00:05:24.829573 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.029s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:05:24 dist-test-slave-6nmv krb5kdc[23108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:05:24.938738 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:46091
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:46091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:25.015084 23126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:25.015254 23126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:25.015273 23126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:25.016300 23126 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:25.016357 23126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:25.016371 23126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:25.016382 23126 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:25.016433 23126 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:25.017765 23126 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:46091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:46091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:25.018015 23126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:25.018226 23126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:25.022541 23132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:25.022562 23131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:25.022679 23126 server_base.cc:1034] running on GCE node
W20260812 00:05:25.022562 23134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:25.023041 23126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:25.023315 23126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:25.024508 23126 hybrid_clock.cc:648] HybridClock initialized: now 1786493125024493 us; error 28 us; skew 500 ppm
Aug 12 00:05:25 dist-test-slave-6nmv krb5kdc[23108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493125, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:25.026839 23126 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:05:25.027170 23126 webserver.cc:460] Webserver started at http://127.19.59.126:37399/ using document root <none> and password file <none>
I20260812 00:05:25.027321 23126 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:25.027356 23126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:25.027439 23126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:25.028249 23126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "de820bb85b8d4a9c9c4c8eeb01cca724"
format_stamp: "Formatted at 2026-08-12 00:05:25 on dist-test-slave-6nmv"
server_key: "35383f5f3310e4e77077c9a1282d5de8"
server_key_iv: "3a4f031f14311ebdbac281d03e08c67c"
server_key_version: "encryptionkey@0"
I20260812 00:05:25.028512 23126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "de820bb85b8d4a9c9c4c8eeb01cca724"
format_stamp: "Formatted at 2026-08-12 00:05:25 on dist-test-slave-6nmv"
server_key: "35383f5f3310e4e77077c9a1282d5de8"
server_key_iv: "3a4f031f14311ebdbac281d03e08c67c"
server_key_version: "encryptionkey@0"
I20260812 00:05:25.029542 23126 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:05:25.030221 23142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:25.030364 23126 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:25.030444 23126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "de820bb85b8d4a9c9c4c8eeb01cca724"
format_stamp: "Formatted at 2026-08-12 00:05:25 on dist-test-slave-6nmv"
server_key: "35383f5f3310e4e77077c9a1282d5de8"
server_key_iv: "3a4f031f14311ebdbac281d03e08c67c"
server_key_version: "encryptionkey@0"
I20260812 00:05:25.030493 23126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:25.047722 23126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:25.049268 23126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:25.049363 23126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:25.053124 23126 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:46091
I20260812 00:05:25.053180 23202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:46091 every 8 connection(s)
I20260812 00:05:25.053649 23126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:25.054250 23203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:25.056206 23203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724: Bootstrap starting.
I20260812 00:05:25.056710 23203 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:25.056981 23203 log.cc:824] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:25.057561 23203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724: No bootstrap required, opened a new log
I20260812 00:05:25.058967 23203 raft_consensus.cc:348] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de820bb85b8d4a9c9c4c8eeb01cca724" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46091 } }
I20260812 00:05:25.059105 23203 raft_consensus.cc:374] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:25.059146 23203 raft_consensus.cc:729] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de820bb85b8d4a9c9c4c8eeb01cca724, State: Initialized, Role: FOLLOWER
I20260812 00:05:25.059290 23203 consensus_queue.cc:260] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de820bb85b8d4a9c9c4c8eeb01cca724" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46091 } }
I20260812 00:05:25.059362 23203 raft_consensus.cc:388] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:25.059402 23203 raft_consensus.cc:482] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:25.059448 23203 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:25.060196 23203 raft_consensus.cc:504] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de820bb85b8d4a9c9c4c8eeb01cca724" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46091 } }
I20260812 00:05:25.060304 23203 leader_election.cc:302] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de820bb85b8d4a9c9c4c8eeb01cca724; no voters:
I20260812 00:05:25.060465 23203 leader_election.cc:288] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:25.060490 23207 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:25.060648 23207 raft_consensus.cc:686] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [term 1 LEADER]: Becoming Leader. State: Replica: de820bb85b8d4a9c9c4c8eeb01cca724, State: Running, Role: LEADER
I20260812 00:05:25.060688 23203 sys_catalog.cc:564] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:25.060760 23207 consensus_queue.cc:237] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de820bb85b8d4a9c9c4c8eeb01cca724" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46091 } }
I20260812 00:05:25.061095 23209 sys_catalog.cc:455] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [sys.catalog]: SysCatalogTable state changed. Reason: New leader de820bb85b8d4a9c9c4c8eeb01cca724. Latest consensus state: current_term: 1 leader_uuid: "de820bb85b8d4a9c9c4c8eeb01cca724" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de820bb85b8d4a9c9c4c8eeb01cca724" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46091 } } }
I20260812 00:05:25.061184 23209 sys_catalog.cc:458] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:25.061088 23208 sys_catalog.cc:455] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de820bb85b8d4a9c9c4c8eeb01cca724" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de820bb85b8d4a9c9c4c8eeb01cca724" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46091 } } }
I20260812 00:05:25.061388 23208 sys_catalog.cc:458] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:25.061383 23216 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:25.062044 23216 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:25.062956 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 23126
I20260812 00:05:25.063059 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:25.063232 19693 external_mini_cluster.cc:1428] Setting key 1f121575193acecd5a5de38b020777c2
I20260812 00:05:25.063894 23216 catalog_manager.cc:1347] Generated new cluster ID: 9eb67e1c82f7482881eeb4ae0e3ac09a
I20260812 00:05:25.063951 23216 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:05:25 dist-test-slave-6nmv krb5kdc[23108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:25.075802 23231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:25.063811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34700 (local address 127.19.59.126:46091)
0812 00:05:25.063963 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:25.063971 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:25.063999 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:05:25.064118 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:25.064125 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:25.064169 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:25.064267 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:25.066515 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:25.067737 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:25.068784 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:25.069333 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:25.069418 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:25.072219 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:25.072223 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:25.072223 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:25.072235 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:25.074234 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:25.074621 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:25.074623 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:25.074624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:25.074730 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:25.074929 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:25.074930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:25.074930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:25.075228 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:25.075385 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:25.075466 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 00:05:25.075595 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":69,"threads_started":1}
I20260812 00:05:25.076778 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:05:25.080000 23216 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:25.080444 23216 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:25.090212 23216 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de820bb85b8d4a9c9c4c8eeb01cca724: Generated new TSK 0
I20260812 00:05:25.090440 23216 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:05:25.094475 23231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:25.090758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34712 (local address 127.19.59.126:46091)
0812 00:05:25.090820 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:25.090822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:25.090938 (+ 116us) server_negotiation.cc:407] Connection header received
0812 00:05:25.090967 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:25.090968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:25.090980 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:25.091054 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:25.091371 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:25.092175 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:25.092878 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:25.093237 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:25.093311 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:25.093997 (+ 686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:25.093998 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:25.093998 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:25.094208 (+ 210us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:25.094225 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:25.094233 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:25.094297 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:25.094366 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 00:05:25.094390 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 00:05:25.096628 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 23126
2026-08-12T00:05:25Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1320 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:25 dist-test-slave-6nmv krb5kdc[23243](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:25 dist-test-slave-6nmv krb5kdc[23243](info): set up 2 sockets
Aug 12 00:05:25 dist-test-slave-6nmv krb5kdc[23243](info): commencing operation
krb5kdc: starting...
W20260812 00:05:26.151343 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:05:26 dist-test-slave-6nmv krb5kdc[23243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493126, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:05:26.266989 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:40755
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:37981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:40755
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:26.345953 23258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:26.346179 23258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:26.346215 23258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:26.347308 23258 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:26.347385 23258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:26.347409 23258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:26.347446 23258 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:26.347468 23258 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:26.348899 23258 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:40755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:40755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:26.349176 23258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:26.349395 23258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:26.354019 23272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:26.354161 23258 server_base.cc:1034] running on GCE node
W20260812 00:05:26.354010 23265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:26.354019 23264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:26.354483 23258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:26.354780 23258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:26.355935 23258 hybrid_clock.cc:648] HybridClock initialized: now 1786493126355920 us; error 42 us; skew 500 ppm
Aug 12 00:05:26 dist-test-slave-6nmv krb5kdc[23243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493126, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:26.358661 23258 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:05:26.359074 23258 webserver.cc:460] Webserver started at http://127.19.59.126:42325/ using document root <none> and password file <none>
I20260812 00:05:26.359306 23258 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:26.359373 23258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:26.359524 23258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:26.360489 23258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "d5975efeac3740879cc68ed646a9c79e"
format_stamp: "Formatted at 2026-08-12 00:05:26 on dist-test-slave-6nmv"
server_key: "733ea9c0d36deb96e114cb0ff85a6882"
server_key_iv: "621f3226f5bcb58bdee04312efe82169"
server_key_version: "encryptionkey@0"
I20260812 00:05:26.360849 23258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "d5975efeac3740879cc68ed646a9c79e"
format_stamp: "Formatted at 2026-08-12 00:05:26 on dist-test-slave-6nmv"
server_key: "733ea9c0d36deb96e114cb0ff85a6882"
server_key_iv: "621f3226f5bcb58bdee04312efe82169"
server_key_version: "encryptionkey@0"
I20260812 00:05:26.362254 23258 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:26.363000 23283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:26.363176 23258 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:26.363277 23258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "d5975efeac3740879cc68ed646a9c79e"
format_stamp: "Formatted at 2026-08-12 00:05:26 on dist-test-slave-6nmv"
server_key: "733ea9c0d36deb96e114cb0ff85a6882"
server_key_iv: "621f3226f5bcb58bdee04312efe82169"
server_key_version: "encryptionkey@0"
I20260812 00:05:26.363358 23258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:26.387123 23258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:26.389206 23258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:26.389356 23258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:26.393399 23258 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:40755
I20260812 00:05:26.393450 23341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:40755 every 8 connection(s)
I20260812 00:05:26.393797 23258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:26.394738 23343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:26.396800 23343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e: Bootstrap starting.
I20260812 00:05:26.397377 23343 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:26.397677 23343 log.cc:824] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:26.398427 23343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e: No bootstrap required, opened a new log
I20260812 00:05:26.399837 23343 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5975efeac3740879cc68ed646a9c79e" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40755 } }
I20260812 00:05:26.399962 23343 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:26.399983 23343 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5975efeac3740879cc68ed646a9c79e, State: Initialized, Role: FOLLOWER
I20260812 00:05:26.400177 23343 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5975efeac3740879cc68ed646a9c79e" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40755 } }
I20260812 00:05:26.400238 23343 raft_consensus.cc:388] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:26.400259 23343 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:26.400326 23343 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:26.401089 23343 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5975efeac3740879cc68ed646a9c79e" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40755 } }
I20260812 00:05:26.401213 23343 leader_election.cc:302] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5975efeac3740879cc68ed646a9c79e; no voters:
I20260812 00:05:26.401396 23343 leader_election.cc:288] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:26.401430 23347 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:26.401616 23347 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [term 1 LEADER]: Becoming Leader. State: Replica: d5975efeac3740879cc68ed646a9c79e, State: Running, Role: LEADER
I20260812 00:05:26.401703 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 23258
I20260812 00:05:26.401829 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:26.401803 23347 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5975efeac3740879cc68ed646a9c79e" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40755 } }
I20260812 00:05:26.401690 23343 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:26.402051 19693 external_mini_cluster.cc:1428] Setting key 591483eaf947c1bccb3ee125d27042a8
I20260812 00:05:26.402173 23348 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5975efeac3740879cc68ed646a9c79e. Latest consensus state: current_term: 1 leader_uuid: "d5975efeac3740879cc68ed646a9c79e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5975efeac3740879cc68ed646a9c79e" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40755 } } }
I20260812 00:05:26.402174 23349 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5975efeac3740879cc68ed646a9c79e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5975efeac3740879cc68ed646a9c79e" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40755 } } }
I20260812 00:05:26.402298 23348 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:26.402318 23349 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:26.402550 23353 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:26.403088 23353 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:26.404824 23353 catalog_manager.cc:1347] Generated new cluster ID: 2770c84c50db4f0697b4bc9a858a7bd5
I20260812 00:05:26.404876 23353 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:05:26 dist-test-slave-6nmv krb5kdc[23243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493126, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:26.414405 23360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:26.402801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41660 (local address 127.19.59.126:40755)
0812 00:05:26.403827 (+ 1026us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:26.403834 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:26.403857 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:05:26.403937 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:26.403942 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:26.403980 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:26.404119 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:26.404847 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.406135 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.407128 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.407753 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.407872 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:26.410653 (+ 2781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:26.410657 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:26.410658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:26.410668 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:26.412611 (+ 1943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:26.413027 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:26.413030 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:26.413030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:26.413145 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:26.413354 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:26.413355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:26.413355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:26.413655 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:26.413812 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:26.413967 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 00:05:26.414191 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":990,"thread_start_us":74,"threads_started":1}
I20260812 00:05:26.423892 23353 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:26.424347 23353 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:26.427794 23353 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5975efeac3740879cc68ed646a9c79e: Generated new TSK 0
I20260812 00:05:26.427971 23353 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:05:26.460232 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40755
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:37981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:26.540558 23373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:26.540738 23373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:26.540758 23373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:26.541874 23373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:26.541914 23373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:26.541939 23373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:05:26.543380 23373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:26.543584 23373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:26.543829 23373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:26.548631 23382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:26.548647 23379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:26.548686 23373 server_base.cc:1034] running on GCE node
W20260812 00:05:26.548637 23380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:26.548992 23373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:26.549252 23373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:26.550410 23373 hybrid_clock.cc:648] HybridClock initialized: now 1786493126550399 us; error 27 us; skew 500 ppm
Aug 12 00:05:26 dist-test-slave-6nmv krb5kdc[23243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493126, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:26.552903 23373 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:05:26.553262 23373 webserver.cc:460] Webserver started at http://127.19.59.65:44945/ using document root <none> and password file <none>
I20260812 00:05:26.553440 23373 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:26.553488 23373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:26.553572 23373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:26.554606 23373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "5cae96d80d5043199cd338e7a2a2cd22"
format_stamp: "Formatted at 2026-08-12 00:05:26 on dist-test-slave-6nmv"
server_key: "8d8c368dbaa43fe7b73ef65fbca15b64"
server_key_iv: "a72de018b3adef52e4400cdaacb7ac4c"
server_key_version: "encryptionkey@0"
I20260812 00:05:26.554893 23373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "5cae96d80d5043199cd338e7a2a2cd22"
format_stamp: "Formatted at 2026-08-12 00:05:26 on dist-test-slave-6nmv"
server_key: "8d8c368dbaa43fe7b73ef65fbca15b64"
server_key_iv: "a72de018b3adef52e4400cdaacb7ac4c"
server_key_version: "encryptionkey@0"
I20260812 00:05:26.556003 23373 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:26.556680 23391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:26.556866 23373 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:26.556972 23373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "5cae96d80d5043199cd338e7a2a2cd22"
format_stamp: "Formatted at 2026-08-12 00:05:26 on dist-test-slave-6nmv"
server_key: "8d8c368dbaa43fe7b73ef65fbca15b64"
server_key_iv: "a72de018b3adef52e4400cdaacb7ac4c"
server_key_version: "encryptionkey@0"
I20260812 00:05:26.557060 23373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:26.568429 23373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:26.570550 23373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:26.570684 23373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:26.570914 23373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:26.571204 23373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:26.571259 23373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:26.571298 23373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:26.571326 23373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:26.577198 23373 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:34061
I20260812 00:05:26.577307 23517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:34061 every 8 connection(s)
I20260812 00:05:26.577602 23373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:05:26 dist-test-slave-6nmv krb5kdc[23243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493126, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:26.584913 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 23373
I20260812 00:05:26.585035 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:26.585283 19693 external_mini_cluster.cc:1428] Setting key a7a61ca7908e15cd9d14dc75968b714e
I20260812 00:05:26.586856 23360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:26.578365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:37247 (local address 127.19.59.126:40755)
0812 00:05:26.578427 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:26.578429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:26.578594 (+ 165us) server_negotiation.cc:407] Connection header received
0812 00:05:26.579049 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:26.579050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:26.579063 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:26.579124 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:26.579962 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.580467 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.581412 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.581624 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.581677 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:26.583830 (+ 2153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:26.583831 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:26.583831 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:26.583838 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:26.585408 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:26.585803 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:26.585804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:26.585805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:26.585890 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:26.586225 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:26.586226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:26.586226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:26.586340 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:26.586398 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:26.586723 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 00:05:26.586793 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:05:26.587142 23522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:26.578320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:40755 (local address 127.19.59.65:37247)
0812 00:05:26.578471 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:26.578508 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:26.578973 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:26.579172 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:26.579175 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:26.579704 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:26.579881 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:26.579885 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.580547 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.580547 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:26.581305 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:26.581307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.581717 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.581717 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:26.581876 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:26.582409 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:26.582416 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:26.583740 (+ 1324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:26.585497 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:26.585505 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:26.585507 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:26.585738 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:26.585997 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:26.585998 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:26.585998 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:26.586141 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:26.586411 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:26.586417 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:26.586583 (+ 166us) client_negotiation.cc:769] Sending connection context
0812 00:05:26.586701 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 00:05:26.586880 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":80,"threads_started":1}
I20260812 00:05:26.587708 23518 heartbeater.cc:347] Connected to a master server at 127.19.59.126:40755
I20260812 00:05:26.587818 23518 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:26.588021 23518 heartbeater.cc:511] Master 127.19.59.126:40755 requested a full tablet report, sending...
I20260812 00:05:26.588538 23302 ts_manager.cc:194] Registered new tserver with Master: 5cae96d80d5043199cd338e7a2a2cd22 (127.19.59.65:34061)
I20260812 00:05:26.589141 23302 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:37247
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:05:26.612637 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40755
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:37981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:26.691861 23525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:26.692049 23525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:26.692072 23525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:26.693141 23525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:26.693176 23525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:26.693202 23525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:05:26.694557 23525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:26.694736 23525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:26.694881 23525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:26.699416 23531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:26.699580 23525 server_base.cc:1034] running on GCE node
W20260812 00:05:26.699465 23532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:26.699453 23534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:26.699865 23525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:26.700129 23525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:26.701320 23525 hybrid_clock.cc:648] HybridClock initialized: now 1786493126701304 us; error 26 us; skew 500 ppm
Aug 12 00:05:26 dist-test-slave-6nmv krb5kdc[23243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493126, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:26.703938 23525 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:05:26.704319 23525 webserver.cc:460] Webserver started at http://127.19.59.66:43515/ using document root <none> and password file <none>
I20260812 00:05:26.704526 23525 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:26.704589 23525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:26.704728 23525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:26.705637 23525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "b25a03b6b9ba496298df5f59ea37c461"
format_stamp: "Formatted at 2026-08-12 00:05:26 on dist-test-slave-6nmv"
server_key: "27f70abea973e3cbf951b227bfe2e798"
server_key_iv: "7588550303af5cb2ef925513e742d25e"
server_key_version: "encryptionkey@0"
I20260812 00:05:26.706049 23525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "b25a03b6b9ba496298df5f59ea37c461"
format_stamp: "Formatted at 2026-08-12 00:05:26 on dist-test-slave-6nmv"
server_key: "27f70abea973e3cbf951b227bfe2e798"
server_key_iv: "7588550303af5cb2ef925513e742d25e"
server_key_version: "encryptionkey@0"
I20260812 00:05:26.707436 23525 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:26.708158 23542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:26.708341 23525 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:26.708433 23525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "b25a03b6b9ba496298df5f59ea37c461"
format_stamp: "Formatted at 2026-08-12 00:05:26 on dist-test-slave-6nmv"
server_key: "27f70abea973e3cbf951b227bfe2e798"
server_key_iv: "7588550303af5cb2ef925513e742d25e"
server_key_version: "encryptionkey@0"
I20260812 00:05:26.708509 23525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:26.718089 23525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:26.719699 23525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:26.719846 23525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:26.720062 23525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:26.720342 23525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:26.720413 23525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:26.720445 23525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:26.720470 23525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:26.726274 23525 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:45105
I20260812 00:05:26.726311 23682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:45105 every 8 connection(s)
I20260812 00:05:26.726624 23525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:26.727545 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 23525
I20260812 00:05:26.727653 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:26.727833 19693 external_mini_cluster.cc:1428] Setting key 0ddd20948359c9e1d37b980d95c8cdb2
Aug 12 00:05:26 dist-test-slave-6nmv krb5kdc[23243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493126, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
I20260812 00:05:26.736184 23360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:26.727272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:50361 (local address 127.19.59.126:40755)
0812 00:05:26.727334 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:26.727336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:26.727508 (+ 172us) server_negotiation.cc:407] Connection header received
0812 00:05:26.727978 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:26.727979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:26.727991 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:26.728059 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:26.728930 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.729394 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.730761 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.730963 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.731019 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:26.733422 (+ 2403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:26.733424 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:26.733424 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:26.733431 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:26.734809 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:26.735208 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:26.735209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:26.735210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:26.735271 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:26.735536 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:26.735537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:26.735538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:26.735654 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:26.735727 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:26.736016 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 00:05:26.736102 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:05:26.736346 23688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:26.727203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:40755 (local address 127.19.59.66:50361)
0812 00:05:26.727359 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:26.727411 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:26.727878 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:26.728121 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:26.728125 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:26.728684 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:26.728842 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:26.728846 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.729487 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.729488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:26.730669 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:26.730672 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.731047 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.731048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:26.731178 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:26.731672 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:26.731682 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:26.733307 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:26.734909 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:26.734916 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:26.734919 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:26.735132 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:26.735335 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:26.735336 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:26.735337 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:26.735468 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:26.735731 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:26.735739 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:26.735870 (+ 131us) client_negotiation.cc:769] Sending connection context
0812 00:05:26.735970 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 00:05:26.736130 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":83,"threads_started":1}
I20260812 00:05:26.736804 23684 heartbeater.cc:347] Connected to a master server at 127.19.59.126:40755
I20260812 00:05:26.736893 23684 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:26.737090 23684 heartbeater.cc:511] Master 127.19.59.126:40755 requested a full tablet report, sending...
I20260812 00:05:26.737473 23302 ts_manager.cc:194] Registered new tserver with Master: b25a03b6b9ba496298df5f59ea37c461 (127.19.59.66:45105)
I20260812 00:05:26.737780 23302 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:50361
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:05:26.752696 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40755
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:37981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:26.831957 23691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:26.832154 23691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:26.832175 23691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:26.833222 23691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:26.833256 23691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:26.833280 23691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:05:26.834546 23691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:26.834712 23691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:26.834863 23691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:26.839351 23697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:26.839407 23701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:26.839381 23699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:26.839416 23691 server_base.cc:1034] running on GCE node
I20260812 00:05:26.839735 23691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:26.839984 23691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:26.841121 23691 hybrid_clock.cc:648] HybridClock initialized: now 1786493126841112 us; error 30 us; skew 500 ppm
Aug 12 00:05:26 dist-test-slave-6nmv krb5kdc[23243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493126, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:26.843750 23691 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:05:26.844179 23691 webserver.cc:460] Webserver started at http://127.19.59.67:35663/ using document root <none> and password file <none>
I20260812 00:05:26.844389 23691 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:26.844444 23691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:26.844565 23691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:26.845470 23691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "16b5ea8935e046f5a68c8a78a0f66d50"
format_stamp: "Formatted at 2026-08-12 00:05:26 on dist-test-slave-6nmv"
server_key: "7bd25e47b2b5f2b7e2bb754c394ba08d"
server_key_iv: "2cc78a31ae703bb98ff117316400f4da"
server_key_version: "encryptionkey@0"
I20260812 00:05:26.845793 23691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "16b5ea8935e046f5a68c8a78a0f66d50"
format_stamp: "Formatted at 2026-08-12 00:05:26 on dist-test-slave-6nmv"
server_key: "7bd25e47b2b5f2b7e2bb754c394ba08d"
server_key_iv: "2cc78a31ae703bb98ff117316400f4da"
server_key_version: "encryptionkey@0"
I20260812 00:05:26.847059 23691 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:26.847718 23712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:26.847901 23691 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:26.847972 23691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "16b5ea8935e046f5a68c8a78a0f66d50"
format_stamp: "Formatted at 2026-08-12 00:05:26 on dist-test-slave-6nmv"
server_key: "7bd25e47b2b5f2b7e2bb754c394ba08d"
server_key_iv: "2cc78a31ae703bb98ff117316400f4da"
server_key_version: "encryptionkey@0"
I20260812 00:05:26.848059 23691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:26.865675 23691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:26.867854 23691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:26.868000 23691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:26.868238 23691 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:26.868533 23691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:26.868566 23691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:26.868584 23691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:26.868616 23691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:26.874190 23691 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:35489
I20260812 00:05:26.874253 23847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:35489 every 8 connection(s)
I20260812 00:05:26.874559 23691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:26.877465 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 23691
I20260812 00:05:26.877586 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:26.877799 19693 external_mini_cluster.cc:1428] Setting key 51f8746d989fd89dc8915f6613618aa7
Aug 12 00:05:26 dist-test-slave-6nmv krb5kdc[23243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493126, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:26.883355 23360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:26.875205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:55861 (local address 127.19.59.126:40755)
0812 00:05:26.875271 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:26.875273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:26.875489 (+ 216us) server_negotiation.cc:407] Connection header received
0812 00:05:26.876021 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:26.876022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:26.876035 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:26.876084 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:26.877010 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.877586 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.878743 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.878957 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.879031 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:26.881014 (+ 1983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:26.881015 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:26.881016 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:26.881022 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:26.882229 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:26.882608 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:26.882609 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:26.882610 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:26.882661 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:26.882866 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:26.882867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:26.882867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:26.882965 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:26.883015 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:26.883231 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 00:05:26.883292 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 00:05:26.883569 23851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:26.875201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:40755 (local address 127.19.59.67:55861)
0812 00:05:26.875371 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:26.875404 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:26.875907 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:26.876147 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:26.876157 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:26.876725 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:26.876904 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:26.876908 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.877699 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.877700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:26.878599 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:26.878601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.879057 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.879058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:26.879164 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:26.879593 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:26.879600 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:26.880930 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:26.882301 (+ 1371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:26.882325 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:26.882326 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:26.882544 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:26.882717 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:26.882718 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:26.882718 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:26.882813 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:26.883018 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:26.883022 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:26.883124 (+ 102us) client_negotiation.cc:769] Sending connection context
0812 00:05:26.883203 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 00:05:26.883314 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
I20260812 00:05:26.884024 23848 heartbeater.cc:347] Connected to a master server at 127.19.59.126:40755
I20260812 00:05:26.884128 23848 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:26.884274 23848 heartbeater.cc:511] Master 127.19.59.126:40755 requested a full tablet report, sending...
I20260812 00:05:26.884591 23302 ts_manager.cc:194] Registered new tserver with Master: 16b5ea8935e046f5a68c8a78a0f66d50 (127.19.59.67:35489)
I20260812 00:05:26.884900 23302 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:55861
I20260812 00:05:26.889398 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:05:26 dist-test-slave-6nmv krb5kdc[23243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493126, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 00:05:26 dist-test-slave-6nmv krb5kdc[23243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493126, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:26.912889 23360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:26.905679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41664 (local address 127.19.59.126:40755)
0812 00:05:26.905761 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:26.905763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:26.905911 (+ 148us) server_negotiation.cc:407] Connection header received
0812 00:05:26.906011 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:26.906012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:26.906024 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:26.906094 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:26.906672 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.907228 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.907939 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.908128 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.908196 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:26.910519 (+ 2323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:26.910520 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:26.910521 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:26.910527 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:26.911862 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:26.912245 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:26.912246 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:26.912246 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:26.912299 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:26.912476 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:26.912476 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:26.912476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:26.912609 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:26.912685 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:26.912770 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 00:05:26.912826 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260812 00:05:26.913125 23302 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41664
I20260812 00:05:26.913683 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 23373
I20260812 00:05:26.919795 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 23525
I20260812 00:05:26.925115 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 23691
I20260812 00:05:26.931149 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 23258
2026-08-12T00:05:26Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1831 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:26 dist-test-slave-6nmv krb5kdc[23861](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:26 dist-test-slave-6nmv krb5kdc[23861](info): set up 2 sockets
Aug 12 00:05:26 dist-test-slave-6nmv krb5kdc[23861](info): commencing operation
krb5kdc: starting...
W20260812 00:05:27.995091 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:05:28 dist-test-slave-6nmv krb5kdc[23861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:05:28.116591 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:35235
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:42303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:35235
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:28.198271 23876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:28.198453 23876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:28.198473 23876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:28.199615 23876 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:28.199657 23876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:28.199671 23876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:28.199683 23876 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:28.199694 23876 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:28.201274 23876 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:42303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:35235
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:35235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:28.201524 23876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:28.201745 23876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:28.206642 23885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:28.206640 23883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:28.206643 23881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:28.206946 23876 server_base.cc:1034] running on GCE node
I20260812 00:05:28.207228 23876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:28.207522 23876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:28.208690 23876 hybrid_clock.cc:648] HybridClock initialized: now 1786493128208686 us; error 37 us; skew 500 ppm
Aug 12 00:05:28 dist-test-slave-6nmv krb5kdc[23861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493128, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:28.220386 23876 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:05:28.220810 23876 webserver.cc:460] Webserver started at http://127.19.59.126:45871/ using document root <none> and password file <none>
I20260812 00:05:28.221061 23876 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:28.221107 23876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:28.221200 23876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:28.222363 23876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "5005a220d2d5400582d0b41186db8be1"
format_stamp: "Formatted at 2026-08-12 00:05:28 on dist-test-slave-6nmv"
server_key: "f4a1ee39b11afb93620d1a2547e9943a"
server_key_iv: "5f8faf5b1769cc564226cfa99c6c7711"
server_key_version: "encryptionkey@0"
I20260812 00:05:28.222700 23876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "5005a220d2d5400582d0b41186db8be1"
format_stamp: "Formatted at 2026-08-12 00:05:28 on dist-test-slave-6nmv"
server_key: "f4a1ee39b11afb93620d1a2547e9943a"
server_key_iv: "5f8faf5b1769cc564226cfa99c6c7711"
server_key_version: "encryptionkey@0"
I20260812 00:05:28.223975 23876 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:28.224702 23894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:28.224891 23876 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:28.224985 23876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "5005a220d2d5400582d0b41186db8be1"
format_stamp: "Formatted at 2026-08-12 00:05:28 on dist-test-slave-6nmv"
server_key: "f4a1ee39b11afb93620d1a2547e9943a"
server_key_iv: "5f8faf5b1769cc564226cfa99c6c7711"
server_key_version: "encryptionkey@0"
I20260812 00:05:28.225044 23876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:28.249208 23876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:28.251220 23876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:28.251339 23876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:28.255887 23876 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:35235
I20260812 00:05:28.255966 23956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:35235 every 8 connection(s)
I20260812 00:05:28.256466 23876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:28.257184 23957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:28.259524 23957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1: Bootstrap starting.
I20260812 00:05:28.260108 23957 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:28.260411 23957 log.cc:824] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:28.261128 23957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1: No bootstrap required, opened a new log
I20260812 00:05:28.262012 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 23876
I20260812 00:05:28.262099 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:28.262298 19693 external_mini_cluster.cc:1428] Setting key de8bc4139b30d1b94827300f6dc3be10
I20260812 00:05:28.263937 23957 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5005a220d2d5400582d0b41186db8be1" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35235 } }
I20260812 00:05:28.264122 23957 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:28.264166 23957 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5005a220d2d5400582d0b41186db8be1, State: Initialized, Role: FOLLOWER
I20260812 00:05:28.264329 23957 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5005a220d2d5400582d0b41186db8be1" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35235 } }
I20260812 00:05:28.264416 23957 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:28.264441 23957 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:28.264511 23957 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:28.265169 23957 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5005a220d2d5400582d0b41186db8be1" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35235 } }
I20260812 00:05:28.265272 23957 leader_election.cc:302] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5005a220d2d5400582d0b41186db8be1; no voters:
I20260812 00:05:28.265443 23957 leader_election.cc:288] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:28.265517 23962 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:28.265662 23962 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [term 1 LEADER]: Becoming Leader. State: Replica: 5005a220d2d5400582d0b41186db8be1, State: Running, Role: LEADER
I20260812 00:05:28.265702 23957 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:28.266479 23962 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5005a220d2d5400582d0b41186db8be1" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35235 } }
I20260812 00:05:28.267155 23964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5005a220d2d5400582d0b41186db8be1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5005a220d2d5400582d0b41186db8be1" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35235 } } }
I20260812 00:05:28.267279 23964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:28.267297 23963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5005a220d2d5400582d0b41186db8be1. Latest consensus state: current_term: 1 leader_uuid: "5005a220d2d5400582d0b41186db8be1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5005a220d2d5400582d0b41186db8be1" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35235 } } }
I20260812 00:05:28.267391 23963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:28.267627 23983 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:28.268033 23983 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:28.269654 23983 catalog_manager.cc:1347] Generated new cluster ID: 27eb27905fe24a02a5609fc7a5e4de2a
I20260812 00:05:28.269709 23983 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:05:28 dist-test-slave-6nmv krb5kdc[23861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:28.274343 23961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:28.262887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34870 (local address 127.19.59.126:35235)
0812 00:05:28.263096 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:28.263108 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:28.263144 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:05:28.263893 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:28.263902 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:28.263970 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:28.264123 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:28.264898 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.266318 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.267513 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.268142 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.268251 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:28.270705 (+ 2454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:28.270709 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:28.270709 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:28.270719 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:28.272340 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:28.272747 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:28.272749 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:28.272750 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:28.272857 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:28.273092 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:28.273093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:28.273093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:28.273322 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:28.274031 (+ 709us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:28.274091 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 00:05:28.274201 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":87,"threads_started":1}
I20260812 00:05:28.281880 23983 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:28.282675 23983 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:28.289269 23983 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5005a220d2d5400582d0b41186db8be1: Generated new TSK 0
I20260812 00:05:28.289450 23983 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:05:28.320958 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35235
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:42303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:28.400625 23989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:28.400848 23989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:28.400882 23989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:28.402002 23989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:28.402079 23989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:28.402132 23989 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:05:28.403790 23989 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:42303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:28.404031 23989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:28.404238 23989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:28.409229 23997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:28.409222 24001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:28.409409 23989 server_base.cc:1034] running on GCE node
W20260812 00:05:28.409454 23998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:28.409703 23989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:28.409977 23989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:28.411164 23989 hybrid_clock.cc:648] HybridClock initialized: now 1786493128411137 us; error 41 us; skew 500 ppm
Aug 12 00:05:28 dist-test-slave-6nmv krb5kdc[23861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493128, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:28.413959 23989 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:05:28.414372 23989 webserver.cc:460] Webserver started at http://127.19.59.65:41557/ using document root <none> and password file <none>
I20260812 00:05:28.414577 23989 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:28.414640 23989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:28.414786 23989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:28.415748 23989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "c467fd6c727b4170b6db44881bfa206d"
format_stamp: "Formatted at 2026-08-12 00:05:28 on dist-test-slave-6nmv"
server_key: "6410a8fcbb4866584f3a7b83e89e39c6"
server_key_iv: "c415d5eed89ec8168f345e273eb966d5"
server_key_version: "encryptionkey@0"
I20260812 00:05:28.416119 23989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "c467fd6c727b4170b6db44881bfa206d"
format_stamp: "Formatted at 2026-08-12 00:05:28 on dist-test-slave-6nmv"
server_key: "6410a8fcbb4866584f3a7b83e89e39c6"
server_key_iv: "c415d5eed89ec8168f345e273eb966d5"
server_key_version: "encryptionkey@0"
I20260812 00:05:28.417336 23989 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:28.417996 24008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:28.418159 23989 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:28.418244 23989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "c467fd6c727b4170b6db44881bfa206d"
format_stamp: "Formatted at 2026-08-12 00:05:28 on dist-test-slave-6nmv"
server_key: "6410a8fcbb4866584f3a7b83e89e39c6"
server_key_iv: "c415d5eed89ec8168f345e273eb966d5"
server_key_version: "encryptionkey@0"
I20260812 00:05:28.418319 23989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:28.438371 23989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:28.440027 23989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:28.440176 23989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:28.440387 23989 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:28.440670 23989 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:28.440721 23989 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:28.440757 23989 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:28.440783 23989 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:28.446645 23989 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:42677
I20260812 00:05:28.446749 24142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:42677 every 8 connection(s)
I20260812 00:05:28.447006 23989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:05:28 dist-test-slave-6nmv krb5kdc[23861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493128, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:28.455399 23961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:28.447703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:60827 (local address 127.19.59.126:35235)
0812 00:05:28.447776 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:28.447778 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:28.447924 (+ 146us) server_negotiation.cc:407] Connection header received
0812 00:05:28.448784 (+ 860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:28.448785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:28.448798 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:28.448843 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:28.449354 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.449802 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.450718 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.450920 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.450969 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:28.453053 (+ 2084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:28.453054 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:28.453054 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:28.453060 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:28.454294 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:28.454659 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:28.454660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:28.454660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:28.454707 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:28.454898 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:28.454898 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:28.454898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:28.455002 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:28.455049 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:28.455273 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 00:05:28.455337 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 00:05:28.455545 24146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:28.447666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:35235 (local address 127.19.59.65:60827)
0812 00:05:28.447814 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:28.447844 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:28.448704 (+ 860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:28.448896 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:28.448899 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:28.449125 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:28.449288 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:28.449292 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.449935 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.449936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:28.450648 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:28.450649 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.450989 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.450990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:28.451077 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:28.451546 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:28.451560 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:28.452973 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:28.454358 (+ 1385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:28.454364 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:28.454365 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:28.454599 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:28.454760 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:28.454761 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:28.454761 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:28.454849 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:28.455053 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:28.455056 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:28.455170 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 00:05:28.455245 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:05:28.455353 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":88,"threads_started":1}
I20260812 00:05:28.456015 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 23989
I20260812 00:05:28.456025 24143 heartbeater.cc:347] Connected to a master server at 127.19.59.126:35235
I20260812 00:05:28.456116 24143 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:28.456122 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:28.456275 24143 heartbeater.cc:511] Master 127.19.59.126:35235 requested a full tablet report, sending...
I20260812 00:05:28.456285 19693 external_mini_cluster.cc:1428] Setting key 4e3a82d691624c72651051a9c2b413ec
I20260812 00:05:28.456791 23913 ts_manager.cc:194] Registered new tserver with Master: c467fd6c727b4170b6db44881bfa206d (127.19.59.65:42677)
I20260812 00:05:28.457373 23913 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:60827
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:05:28.480031 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35235
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:42303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:28.559533 24150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:28.559724 24150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:28.559747 24150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:28.560781 24150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:28.560813 24150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:28.560835 24150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:05:28.562201 24150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:42303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:28.562381 24150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:28.562577 24150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:28.567289 24157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:28.567246 24156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:28.567246 24159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:28.567878 24150 server_base.cc:1034] running on GCE node
I20260812 00:05:28.568116 24150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:28.568423 24150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:28.569602 24150 hybrid_clock.cc:648] HybridClock initialized: now 1786493128569580 us; error 44 us; skew 500 ppm
Aug 12 00:05:28 dist-test-slave-6nmv krb5kdc[23861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493128, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:28.572114 24150 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:05:28.572542 24150 webserver.cc:460] Webserver started at http://127.19.59.66:45731/ using document root <none> and password file <none>
I20260812 00:05:28.572767 24150 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:28.572834 24150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:28.572990 24150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:28.574061 24150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "f132754d398842e09882e668c04e9843"
format_stamp: "Formatted at 2026-08-12 00:05:28 on dist-test-slave-6nmv"
server_key: "899a8277e7ff330f76b2341a9568f4c0"
server_key_iv: "3502af54e22890b89ba3dfb2b64423d1"
server_key_version: "encryptionkey@0"
I20260812 00:05:28.574417 24150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "f132754d398842e09882e668c04e9843"
format_stamp: "Formatted at 2026-08-12 00:05:28 on dist-test-slave-6nmv"
server_key: "899a8277e7ff330f76b2341a9568f4c0"
server_key_iv: "3502af54e22890b89ba3dfb2b64423d1"
server_key_version: "encryptionkey@0"
I20260812 00:05:28.575721 24150 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:28.576399 24167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:28.576561 24150 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:28.576656 24150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "f132754d398842e09882e668c04e9843"
format_stamp: "Formatted at 2026-08-12 00:05:28 on dist-test-slave-6nmv"
server_key: "899a8277e7ff330f76b2341a9568f4c0"
server_key_iv: "3502af54e22890b89ba3dfb2b64423d1"
server_key_version: "encryptionkey@0"
I20260812 00:05:28.576733 24150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:28.595665 24150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:28.597340 24150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:28.597504 24150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:28.597725 24150 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:28.598040 24150 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:28.598094 24150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:28.598125 24150 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:28.598152 24150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:28.605031 24150 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:44109
I20260812 00:05:28.605062 24302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:44109 every 8 connection(s)
I20260812 00:05:28.605424 24150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:05:28 dist-test-slave-6nmv krb5kdc[23861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493128, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:28.614537 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 24150
I20260812 00:05:28.614661 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:28.614890 19693 external_mini_cluster.cc:1428] Setting key a3b0a85dcdd519255c981e30bf42deea
I20260812 00:05:28.615361 23961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:28.606283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:60637 (local address 127.19.59.126:35235)
0812 00:05:28.606351 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:28.606353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:28.606495 (+ 142us) server_negotiation.cc:407] Connection header received
0812 00:05:28.607599 (+ 1104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:28.607601 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:28.607614 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:28.607665 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:28.608286 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.608802 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.609730 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.610000 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.610087 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:28.612289 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:28.612291 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:28.612291 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:28.612298 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:28.613906 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:28.614249 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:28.614249 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:28.614250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:28.614300 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:28.614528 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:28.614529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:28.614530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:28.614675 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:28.614742 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:28.615161 (+ 419us) server_negotiation.cc:299] Negotiation successful
0812 00:05:28.615256 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 00:05:28.615497 24306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:28.606212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:35235 (local address 127.19.59.66:60637)
0812 00:05:28.606380 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:28.606425 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:28.607461 (+ 1036us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:28.607741 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:28.607745 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:28.608008 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:28.608187 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:28.608191 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.608893 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.608894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:28.609617 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:28.609619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.610098 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.610100 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:28.610220 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:28.610759 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:28.610768 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:28.612202 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:28.613980 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:28.613986 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:28.613988 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:28.614186 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:28.614354 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:28.614354 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:28.614354 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:28.614457 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:28.614792 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:28.614800 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:28.614960 (+ 160us) client_negotiation.cc:769] Sending connection context
0812 00:05:28.615077 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 00:05:28.615254 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":89,"threads_started":1}
I20260812 00:05:28.616110 24304 heartbeater.cc:347] Connected to a master server at 127.19.59.126:35235
I20260812 00:05:28.616205 24304 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:28.616398 24304 heartbeater.cc:511] Master 127.19.59.126:35235 requested a full tablet report, sending...
I20260812 00:05:28.616776 23913 ts_manager.cc:194] Registered new tserver with Master: f132754d398842e09882e668c04e9843 (127.19.59.66:44109)
I20260812 00:05:28.617136 23913 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:60637
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:05:28.640599 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35235
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:42303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:28.718775 24310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:28.718961 24310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:28.718983 24310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:28.720068 24310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:28.720103 24310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:28.720129 24310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:05:28.721588 24310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:42303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:28.721758 24310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:28.721982 24310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:28.726953 24315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:28.726989 24316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:28.726962 24318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:28.727273 24310 server_base.cc:1034] running on GCE node
I20260812 00:05:28.727500 24310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:28.727751 24310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:28.728885 24310 hybrid_clock.cc:648] HybridClock initialized: now 1786493128728866 us; error 38 us; skew 500 ppm
Aug 12 00:05:28 dist-test-slave-6nmv krb5kdc[23861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493128, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:28.731309 24310 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:05:28.731753 24310 webserver.cc:460] Webserver started at http://127.19.59.67:42671/ using document root <none> and password file <none>
I20260812 00:05:28.731946 24310 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:28.731987 24310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:28.732074 24310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:28.733009 24310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "31e06abc5cfa49bf80412683989262d8"
format_stamp: "Formatted at 2026-08-12 00:05:28 on dist-test-slave-6nmv"
server_key: "ad6cc1e1ea537e069d02eafb21ae0eb3"
server_key_iv: "fc308df23d8327de8b2a073305e2e716"
server_key_version: "encryptionkey@0"
I20260812 00:05:28.733304 24310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "31e06abc5cfa49bf80412683989262d8"
format_stamp: "Formatted at 2026-08-12 00:05:28 on dist-test-slave-6nmv"
server_key: "ad6cc1e1ea537e069d02eafb21ae0eb3"
server_key_iv: "fc308df23d8327de8b2a073305e2e716"
server_key_version: "encryptionkey@0"
I20260812 00:05:28.734639 24310 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 00:05:28.735311 24325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:28.735494 24310 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:28.735561 24310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "31e06abc5cfa49bf80412683989262d8"
format_stamp: "Formatted at 2026-08-12 00:05:28 on dist-test-slave-6nmv"
server_key: "ad6cc1e1ea537e069d02eafb21ae0eb3"
server_key_iv: "fc308df23d8327de8b2a073305e2e716"
server_key_version: "encryptionkey@0"
I20260812 00:05:28.735610 24310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:28.749486 24310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:28.751080 24310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:28.751173 24310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:28.751327 24310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:28.751528 24310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:28.751552 24310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:28.751569 24310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:28.751580 24310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:28.757072 24310 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:34009
I20260812 00:05:28.757123 24457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:34009 every 8 connection(s)
I20260812 00:05:28.757376 24310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:05:28 dist-test-slave-6nmv krb5kdc[23861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493128, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:28.765434 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 24310
I20260812 00:05:28.765547 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:28.765775 19693 external_mini_cluster.cc:1428] Setting key 8746ebcbc079542cb728c0d10b842499
I20260812 00:05:28.766278 23961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:28.758040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:47221 (local address 127.19.59.126:35235)
0812 00:05:28.758190 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:28.758192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:28.758375 (+ 183us) server_negotiation.cc:407] Connection header received
0812 00:05:28.759158 (+ 783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:28.759159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:28.759172 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:28.759237 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:28.759803 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.760270 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.761106 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.761276 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.761334 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:28.763246 (+ 1912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:28.763247 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:28.763247 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:28.763254 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:28.764692 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:28.765050 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:28.765051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:28.765052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:28.765109 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:28.765522 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:28.765523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:28.765524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:28.765678 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:28.765765 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:28.766109 (+ 344us) server_negotiation.cc:299] Negotiation successful
0812 00:05:28.766188 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260812 00:05:28.766451 24461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:28.758013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:35235 (local address 127.19.59.67:47221)
0812 00:05:28.758257 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:28.758286 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:28.759061 (+ 775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:28.759282 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:28.759285 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:28.759510 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:28.759698 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:28.759702 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.760346 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.760346 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:28.761015 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:28.761017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.761347 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.761348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:28.761438 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:28.761801 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:28.761846 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:28.763160 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:28.764767 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:28.764772 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:28.764774 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:28.764983 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:28.765217 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:28.765219 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:28.765219 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:28.765367 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:28.765769 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:28.765776 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:28.765971 (+ 195us) client_negotiation.cc:769] Sending connection context
0812 00:05:28.766084 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 00:05:28.766225 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":183,"threads_started":1}
I20260812 00:05:28.766923 24458 heartbeater.cc:347] Connected to a master server at 127.19.59.126:35235
I20260812 00:05:28.767015 24458 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:28.767181 24458 heartbeater.cc:511] Master 127.19.59.126:35235 requested a full tablet report, sending...
I20260812 00:05:28.767542 23913 ts_manager.cc:194] Registered new tserver with Master: 31e06abc5cfa49bf80412683989262d8 (127.19.59.67:34009)
I20260812 00:05:28.767892 23913 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:47221
I20260812 00:05:28.777532 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:05:28 dist-test-slave-6nmv krb5kdc[23861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:05:28 dist-test-slave-6nmv krb5kdc[23861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.65@KRBTEST.COM
I20260812 00:05:28.799768 24467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:28.792440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33180 (local address 127.19.59.65:42677)
0812 00:05:28.792639 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:28.792643 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:28.792651 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:28.792673 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:28.792675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:28.792688 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:28.792771 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:28.793341 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.794094 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.794822 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.795112 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.795190 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:28.797221 (+ 2031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:28.797229 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:28.797230 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:28.797237 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:28.798669 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:28.798994 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:28.798997 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:28.798998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:28.799057 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:28.799241 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:28.799242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:28.799242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:28.799364 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:28.799512 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:28.799576 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 00:05:28.799646 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":110,"threads_started":1}
Aug 12 00:05:28 dist-test-slave-6nmv krb5kdc[23861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:28.807236 23961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:28.800968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34874 (local address 127.19.59.126:35235)
0812 00:05:28.801026 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:28.801028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:28.801037 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:28.801059 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:28.801060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:28.801069 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:28.801122 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:28.801516 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.802008 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.802634 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:28.802813 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:28.802868 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:28.804903 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:28.804904 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:28.804905 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:28.804911 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:28.806311 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:28.806609 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:28.806610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:28.806610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:28.806672 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:28.806803 (+ 131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:28.806803 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:28.806803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:28.806934 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:28.807000 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:28.807071 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:05:28.807127 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260812 00:05:28.807492 23913 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34874
I20260812 00:05:28.807839 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 23989
I20260812 00:05:28.814785 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 24150
I20260812 00:05:28.821468 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 24310
I20260812 00:05:28.826798 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 23876
2026-08-12T00:05:28Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1896 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:28 dist-test-slave-6nmv krb5kdc[24472](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:28 dist-test-slave-6nmv krb5kdc[24472](info): set up 2 sockets
Aug 12 00:05:28 dist-test-slave-6nmv krb5kdc[24472](info): commencing operation
krb5kdc: starting...
W20260812 00:05:29.923720 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.075s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:05:29 dist-test-slave-6nmv krb5kdc[24472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:05:30.039043 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:46387
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:40023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:46387
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:30.124756 24486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:30.124955 24486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:30.124977 24486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:30.126171 24486 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:30.126214 24486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:30.126228 24486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:30.126241 24486 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:30.126288 24486 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:30.127794 24486 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:40023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:46387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:46387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24486
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:30.128054 24486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:30.128276 24486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:30.133080 24492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:30.133103 24495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:30.133103 24491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:30.133273 24486 server_base.cc:1034] running on GCE node
I20260812 00:05:30.133522 24486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:30.133849 24486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:30.135039 24486 hybrid_clock.cc:648] HybridClock initialized: now 1786493130135017 us; error 38 us; skew 500 ppm
Aug 12 00:05:30 dist-test-slave-6nmv krb5kdc[24472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493130, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:30.137499 24486 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:05:30.137887 24486 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:30.137960 24486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:30.138118 24486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:30.139150 24486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "3f54999f6c964f3e9ee55a57c5b46f70"
format_stamp: "Formatted at 2026-08-12 00:05:30 on dist-test-slave-6nmv"
server_key: "bd9f26718730e816f0c95e9fd66e52fb"
server_key_iv: "03a03431b2935355be36e3a723b8651c"
server_key_version: "encryptionkey@0"
I20260812 00:05:30.139521 24486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "3f54999f6c964f3e9ee55a57c5b46f70"
format_stamp: "Formatted at 2026-08-12 00:05:30 on dist-test-slave-6nmv"
server_key: "bd9f26718730e816f0c95e9fd66e52fb"
server_key_iv: "03a03431b2935355be36e3a723b8651c"
server_key_version: "encryptionkey@0"
I20260812 00:05:30.140926 24486 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:05:30.141649 24504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:30.141852 24486 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:30.141964 24486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "3f54999f6c964f3e9ee55a57c5b46f70"
format_stamp: "Formatted at 2026-08-12 00:05:30 on dist-test-slave-6nmv"
server_key: "bd9f26718730e816f0c95e9fd66e52fb"
server_key_iv: "03a03431b2935355be36e3a723b8651c"
server_key_version: "encryptionkey@0"
I20260812 00:05:30.142047 24486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:30.174240 24486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:30.176491 24486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:30.176662 24486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:30.181190 24486 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:46387
I20260812 00:05:30.181223 24564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:46387 every 8 connection(s)
I20260812 00:05:30.181527 24486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:30.182657 24565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:30.185086 24565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70: Bootstrap starting.
I20260812 00:05:30.185176 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 24486
I20260812 00:05:30.185318 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:30.185523 19693 external_mini_cluster.cc:1428] Setting key 97b50c5bad1ac23cdae374b5fc4478d1
I20260812 00:05:30.185875 24565 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:30.186251 24565 log.cc:824] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:30.187016 24565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70: No bootstrap required, opened a new log
I20260812 00:05:30.188942 24565 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f54999f6c964f3e9ee55a57c5b46f70" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46387 } }
I20260812 00:05:30.189110 24565 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:30.189162 24565 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f54999f6c964f3e9ee55a57c5b46f70, State: Initialized, Role: FOLLOWER
I20260812 00:05:30.189327 24565 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f54999f6c964f3e9ee55a57c5b46f70" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46387 } }
I20260812 00:05:30.189422 24565 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:30.189452 24565 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:30.189500 24565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:30.190311 24565 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f54999f6c964f3e9ee55a57c5b46f70" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46387 } }
I20260812 00:05:30.190445 24565 leader_election.cc:302] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f54999f6c964f3e9ee55a57c5b46f70; no voters:
I20260812 00:05:30.190626 24565 leader_election.cc:288] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:30.190656 24572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:30.190786 24572 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [term 1 LEADER]: Becoming Leader. State: Replica: 3f54999f6c964f3e9ee55a57c5b46f70, State: Running, Role: LEADER
I20260812 00:05:30.190912 24565 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:30.190963 24572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f54999f6c964f3e9ee55a57c5b46f70" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46387 } }
I20260812 00:05:30.191427 24572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f54999f6c964f3e9ee55a57c5b46f70. Latest consensus state: current_term: 1 leader_uuid: "3f54999f6c964f3e9ee55a57c5b46f70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f54999f6c964f3e9ee55a57c5b46f70" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46387 } } }
I20260812 00:05:30.191529 24575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f54999f6c964f3e9ee55a57c5b46f70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f54999f6c964f3e9ee55a57c5b46f70" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46387 } } }
I20260812 00:05:30.191604 24572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:30.191640 24575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:30.191913 24582 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 12 00:05:30 dist-test-slave-6nmv krb5kdc[24472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:30.192483 24582 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:30.194161 24582 catalog_manager.cc:1347] Generated new cluster ID: 965eaaffd84543de88173e2d5f3ef333
I20260812 00:05:30.194211 24582 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:30.196884 24569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.186035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46844 (local address 127.19.59.126:46387)
0812 00:05:30.186251 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:30.186260 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:30.186292 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:05:30.186742 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:30.186749 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:30.186794 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:30.186937 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:30.187603 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.188468 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.189224 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.189944 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.190086 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:30.193080 (+ 2994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:30.193084 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:30.193084 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:30.193097 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:30.195165 (+ 2068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:30.195595 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:30.195598 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:30.195598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:30.195700 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:30.195944 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:30.195945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:30.195945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:30.196201 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:30.196387 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:30.196494 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 00:05:30.196645 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":92,"threads_started":1}
I20260812 00:05:30.227680 24582 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:30.228314 24582 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:30.231514 24582 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70: Generated new TSK 0
I20260812 00:05:30.231714 24582 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:05:30.266021 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46387
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:40023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:30.374773 24598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:30.374963 24598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:30.374986 24598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:30.376014 24598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:30.376047 24598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:30.376072 24598 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:05:30.377442 24598 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:40023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24598
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:30.377617 24598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:30.377781 24598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:30.382470 24605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:30.382432 24607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:30.382434 24604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:30.382764 24598 server_base.cc:1034] running on GCE node
I20260812 00:05:30.383038 24598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:30.383322 24598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:30.384486 24598 hybrid_clock.cc:648] HybridClock initialized: now 1786493130384465 us; error 39 us; skew 500 ppm
Aug 12 00:05:30 dist-test-slave-6nmv krb5kdc[24472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493130, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:30.386775 24598 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:05:30.387096 24598 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:30.387166 24598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:30.387305 24598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:30.388260 24598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "2ced21ad3ac1476ca3664f62f7410ecb"
format_stamp: "Formatted at 2026-08-12 00:05:30 on dist-test-slave-6nmv"
server_key: "b8850c3e583b882e350ae25f28a46163"
server_key_iv: "d7aafacdbf0645687e37d83c89576e3d"
server_key_version: "encryptionkey@0"
I20260812 00:05:30.388613 24598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "2ced21ad3ac1476ca3664f62f7410ecb"
format_stamp: "Formatted at 2026-08-12 00:05:30 on dist-test-slave-6nmv"
server_key: "b8850c3e583b882e350ae25f28a46163"
server_key_iv: "d7aafacdbf0645687e37d83c89576e3d"
server_key_version: "encryptionkey@0"
I20260812 00:05:30.389895 24598 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:30.390619 24613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:30.390800 24598 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:30.390872 24598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "2ced21ad3ac1476ca3664f62f7410ecb"
format_stamp: "Formatted at 2026-08-12 00:05:30 on dist-test-slave-6nmv"
server_key: "b8850c3e583b882e350ae25f28a46163"
server_key_iv: "d7aafacdbf0645687e37d83c89576e3d"
server_key_version: "encryptionkey@0"
I20260812 00:05:30.390950 24598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:30.400203 24598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:30.401904 24598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:30.402040 24598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:30.402240 24598 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:30.402519 24598 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:30.402550 24598 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:30.402598 24598 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:30.402639 24598 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:30.408442 24598 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:35901
I20260812 00:05:30.408474 24743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:35901 every 8 connection(s)
I20260812 00:05:30.408708 24598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:05:30.411469 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 24598
I20260812 00:05:30.411585 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:30.411792 19693 external_mini_cluster.cc:1428] Setting key 92af26147211a2041f20c875028e4b49
Aug 12 00:05:30 dist-test-slave-6nmv krb5kdc[24472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493130, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:30.418707 24569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.409352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:60301 (local address 127.19.59.126:46387)
0812 00:05:30.409435 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:30.409437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:30.409607 (+ 170us) server_negotiation.cc:407] Connection header received
0812 00:05:30.410147 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:30.410148 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:30.410158 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:30.410209 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:30.411061 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.411511 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.412868 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.413090 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.413170 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:30.415715 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:30.415717 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:30.415717 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:30.415725 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:30.417233 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:30.417685 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:30.417687 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:30.417687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:30.417765 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:30.418035 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:30.418036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:30.418036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:30.418148 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:30.418235 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:30.418530 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 00:05:30.418621 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 00:05:30.418859 24746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.409333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:46387 (local address 127.19.59.65:60301)
0812 00:05:30.409502 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:30.409533 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:30.410047 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:30.410266 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:30.410269 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:30.410518 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:30.410991 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:30.410995 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.411619 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.411620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:30.412776 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:30.412779 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.413180 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.413181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:30.413315 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:30.413902 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:30.413923 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:30.415615 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:30.417313 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:30.417320 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:30.417323 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:30.417613 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:30.417846 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:30.417847 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:30.417847 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:30.417966 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:30.418226 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:30.418233 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:30.418358 (+ 125us) client_negotiation.cc:769] Sending connection context
0812 00:05:30.418490 (+ 132us) client_negotiation.cc:240] Negotiation successful
0812 00:05:30.418636 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":105,"threads_started":1}
I20260812 00:05:30.419449 24744 heartbeater.cc:347] Connected to a master server at 127.19.59.126:46387
I20260812 00:05:30.419523 24744 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:30.419674 24744 heartbeater.cc:511] Master 127.19.59.126:46387 requested a full tablet report, sending...
I20260812 00:05:30.420222 24523 ts_manager.cc:194] Registered new tserver with Master: 2ced21ad3ac1476ca3664f62f7410ecb (127.19.59.65:35901)
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
I20260812 00:05:30.421113 24523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:60301
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:05:30.436462 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46387
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:40023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:30.511343 24749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:30.511518 24749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:30.511538 24749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:30.512595 24749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:30.512630 24749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:30.512674 24749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:05:30.514079 24749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:40023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:30.514253 24749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:30.514401 24749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:30.518831 24758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:30.518926 24756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:30.518831 24755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:30.519141 24749 server_base.cc:1034] running on GCE node
I20260812 00:05:30.519320 24749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:30.519531 24749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:30.520663 24749 hybrid_clock.cc:648] HybridClock initialized: now 1786493130520635 us; error 45 us; skew 500 ppm
Aug 12 00:05:30 dist-test-slave-6nmv krb5kdc[24472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493130, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:30.523247 24749 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:05:30.523602 24749 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:30.523677 24749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:30.523801 24749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:30.525175 24749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "22e51970ee6b4817bf811ff18b92f332"
format_stamp: "Formatted at 2026-08-12 00:05:30 on dist-test-slave-6nmv"
server_key: "969ba6401098708fca291bb41082ed0a"
server_key_iv: "f444b8b681960b3337b2fd19cb55eb80"
server_key_version: "encryptionkey@0"
I20260812 00:05:30.525611 24749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "22e51970ee6b4817bf811ff18b92f332"
format_stamp: "Formatted at 2026-08-12 00:05:30 on dist-test-slave-6nmv"
server_key: "969ba6401098708fca291bb41082ed0a"
server_key_iv: "f444b8b681960b3337b2fd19cb55eb80"
server_key_version: "encryptionkey@0"
I20260812 00:05:30.527343 24749 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:30.528124 24764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:30.528324 24749 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:30.528421 24749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "22e51970ee6b4817bf811ff18b92f332"
format_stamp: "Formatted at 2026-08-12 00:05:30 on dist-test-slave-6nmv"
server_key: "969ba6401098708fca291bb41082ed0a"
server_key_iv: "f444b8b681960b3337b2fd19cb55eb80"
server_key_version: "encryptionkey@0"
I20260812 00:05:30.528509 24749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:30.549907 24749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:30.551779 24749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:30.551949 24749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:30.552187 24749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:30.552500 24749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:30.552558 24749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:30.552592 24749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:30.552620 24749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:30.560523 24749 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:42629
I20260812 00:05:30.560565 24892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:42629 every 8 connection(s)
I20260812 00:05:30.560837 24749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:05:30 dist-test-slave-6nmv krb5kdc[24472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493130, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:30.569520 24569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.561745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:33885 (local address 127.19.59.126:46387)
0812 00:05:30.561847 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:30.561849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:30.562030 (+ 181us) server_negotiation.cc:407] Connection header received
0812 00:05:30.562527 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:30.562528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:30.562538 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:30.562591 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:30.563454 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.563955 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.564874 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.565061 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.565112 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:30.567191 (+ 2079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:30.567192 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:30.567192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:30.567199 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:30.568375 (+ 1176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:30.568779 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:30.568780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:30.568780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:30.568831 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:30.569045 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:30.569046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:30.569046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:30.569141 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:30.569190 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:30.569398 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 00:05:30.569458 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 00:05:30.569720 24895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.561698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:46387 (local address 127.19.59.66:33885)
0812 00:05:30.561907 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:30.561942 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:30.562421 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:30.562643 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:30.562645 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:30.562905 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:30.563378 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:30.563383 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.564032 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.564032 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:30.564802 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:30.564804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.565132 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.565133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:30.565226 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:30.565694 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:30.565701 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:30.567108 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:30.568474 (+ 1366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:30.568480 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:30.568482 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:30.568714 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:30.568888 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:30.568888 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:30.568889 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:30.568992 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:30.569192 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:30.569196 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:30.569296 (+ 100us) client_negotiation.cc:769] Sending connection context
0812 00:05:30.569371 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:05:30.569489 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":122,"threads_started":1}
I20260812 00:05:30.570243 24893 heartbeater.cc:347] Connected to a master server at 127.19.59.126:46387
I20260812 00:05:30.570348 24893 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:30.570508 24893 heartbeater.cc:511] Master 127.19.59.126:46387 requested a full tablet report, sending...
I20260812 00:05:30.570950 24523 ts_manager.cc:194] Registered new tserver with Master: 22e51970ee6b4817bf811ff18b92f332 (127.19.59.66:42629)
I20260812 00:05:30.570971 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 24749
I20260812 00:05:30.571080 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:30.571290 19693 external_mini_cluster.cc:1428] Setting key bcb18c6a3ab25aa5e003319e3aa8c720
I20260812 00:05:30.571411 24523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:33885
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:05:30.596493 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46387
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:40023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:30.677053 24898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:30.677227 24898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:30.677248 24898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:30.678423 24898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:30.678464 24898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:30.678489 24898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:05:30.679842 24898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:40023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:30.680029 24898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:30.680189 24898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:30.684788 24907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:30.684842 24905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:30.684772 24904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:30.684953 24898 server_base.cc:1034] running on GCE node
I20260812 00:05:30.685164 24898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:30.685420 24898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:30.686580 24898 hybrid_clock.cc:648] HybridClock initialized: now 1786493130686577 us; error 32 us; skew 500 ppm
Aug 12 00:05:30 dist-test-slave-6nmv krb5kdc[24472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493130, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:30.689071 24898 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:05:30.689405 24898 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:30.689457 24898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:30.689538 24898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:30.690440 24898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "8f289c4fba624892b86e7f3cce63325a"
format_stamp: "Formatted at 2026-08-12 00:05:30 on dist-test-slave-6nmv"
server_key: "b95faf5b88dd2c600e23f9872560e96f"
server_key_iv: "5cffe624a6ae7a771d9c42d4387d0e18"
server_key_version: "encryptionkey@0"
I20260812 00:05:30.690713 24898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "8f289c4fba624892b86e7f3cce63325a"
format_stamp: "Formatted at 2026-08-12 00:05:30 on dist-test-slave-6nmv"
server_key: "b95faf5b88dd2c600e23f9872560e96f"
server_key_iv: "5cffe624a6ae7a771d9c42d4387d0e18"
server_key_version: "encryptionkey@0"
I20260812 00:05:30.692049 24898 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:30.692876 24914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:30.693030 24898 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:30.693115 24898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "8f289c4fba624892b86e7f3cce63325a"
format_stamp: "Formatted at 2026-08-12 00:05:30 on dist-test-slave-6nmv"
server_key: "b95faf5b88dd2c600e23f9872560e96f"
server_key_iv: "5cffe624a6ae7a771d9c42d4387d0e18"
server_key_version: "encryptionkey@0"
I20260812 00:05:30.693168 24898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:30.707595 24898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:30.709254 24898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:30.709357 24898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:30.709535 24898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:30.709896 24898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:30.709933 24898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:30.709954 24898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:30.709998 24898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:30.715852 24898 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:33583
I20260812 00:05:30.715894 25042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:33583 every 8 connection(s)
I20260812 00:05:30.716171 24898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:30.721057 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 24898
I20260812 00:05:30.721122 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:30.721309 19693 external_mini_cluster.cc:1428] Setting key 93758571a2f7064a2409d3ad0f4ac345
Aug 12 00:05:30 dist-test-slave-6nmv krb5kdc[24472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493130, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:30.724822 24569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.716862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:33203 (local address 127.19.59.126:46387)
0812 00:05:30.716946 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:30.716948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:30.717160 (+ 212us) server_negotiation.cc:407] Connection header received
0812 00:05:30.717648 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:30.717650 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:30.717662 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:30.717716 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:30.718674 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.719146 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.720105 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.720305 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.720379 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:30.722564 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:30.722565 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:30.722565 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:30.722572 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:30.723773 (+ 1201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:30.724140 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:30.724141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:30.724141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:30.724189 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:30.724351 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:30.724352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:30.724352 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:30.724444 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:30.724491 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:30.724704 (+ 213us) server_negotiation.cc:299] Negotiation successful
0812 00:05:30.724762 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 00:05:30.724967 25046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.716858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:46387 (local address 127.19.59.67:33203)
0812 00:05:30.717051 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:30.717083 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:30.717549 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:30.717777 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:30.717787 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:30.718125 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:30.718575 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:30.718580 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.719240 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.719241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:30.720002 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:30.720004 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.720386 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.720387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:30.720505 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:30.720937 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:30.720944 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:30.722488 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:30.723858 (+ 1370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:30.723864 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:30.723865 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:30.724080 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:30.724228 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:30.724228 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:30.724228 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:30.724306 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:30.724497 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:30.724501 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:30.724601 (+ 100us) client_negotiation.cc:769] Sending connection context
0812 00:05:30.724676 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:05:30.724781 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":104,"threads_started":1}
I20260812 00:05:30.725492 25043 heartbeater.cc:347] Connected to a master server at 127.19.59.126:46387
I20260812 00:05:30.725584 25043 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:30.725683 25043 heartbeater.cc:511] Master 127.19.59.126:46387 requested a full tablet report, sending...
I20260812 00:05:30.726029 24523 ts_manager.cc:194] Registered new tserver with Master: 8f289c4fba624892b86e7f3cce63325a (127.19.59.67:33583)
I20260812 00:05:30.726377 24523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:33203
I20260812 00:05:30.733026 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:05:30.739914 24569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.734359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46856 (local address 127.19.59.126:46387)
0812 00:05:30.734511 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:30.734513 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:30.734544 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:05:30.734568 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:30.734568 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:30.734577 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:30.734615 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:30.735095 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.735533 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.736228 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.736397 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.736444 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:30.737513 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:30.737514 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:30.737514 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:30.737520 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:30.738945 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:30.739286 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:30.739287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:30.739287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:30.739334 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:30.739508 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:30.739509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:30.739509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:30.739638 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:30.739717 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:30.739801 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 00:05:30.739856 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260812 00:05:30.741428 24523 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46856:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:30.743028 24523 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:30.749258 25061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.745439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55310 (local address 127.19.59.67:33583)
0812 00:05:30.745944 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:30.745947 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:30.745956 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:30.745989 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:30.745991 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:30.746005 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:30.746079 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:30.746245 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.746991 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.748245 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.748897 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.748978 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:30.749035 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:30.749147 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 00:05:30.749183 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":98,"threads_started":1}
I20260812 00:05:30.749246 25059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.745349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:33583 (local address 127.0.0.1:55310)
0812 00:05:30.745523 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:30.745559 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:30.745627 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:30.746093 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:30.746096 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:30.746098 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:30.746161 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:30.746163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.747095 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.747096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:30.748168 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:30.748170 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.748978 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.748979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:30.749054 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:30.749065 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:05:30.749133 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 00:05:30.749180 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":55,"threads_started":1}
I20260812 00:05:30.749868 25060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.745353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:35901 (local address 127.0.0.1:60910)
0812 00:05:30.745753 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:30.745762 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:30.745799 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:30.746194 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:30.746195 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:30.746197 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:30.746246 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:30.746248 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.747619 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.747620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:30.748618 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:30.748621 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.749595 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.749596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:30.749675 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:30.749679 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:30.749728 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:05:30.749761 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":119,"threads_started":1}
I20260812 00:05:30.749979 25057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.745353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:42629 (local address 127.0.0.1:58316)
0812 00:05:30.745871 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:30.745878 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:30.745939 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:30.746234 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:30.746235 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:30.746238 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:30.746287 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:30.746289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.747608 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.747609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:30.748508 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:30.748509 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.749677 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.749678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:30.749746 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:30.749751 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:05:30.749811 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:05:30.749869 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":28,"thread_start_us":111,"threads_started":1}
I20260812 00:05:30.750032 24968 tablet_service.cc:1467] Processing CreateTablet for tablet dafdf32ca8fe431f99e62456d03f99e9 (DEFAULT_TABLE table=test-table [id=497976edc4f8498ab4b072191a6d16a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:30.750231 25062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.745632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58316 (local address 127.19.59.66:42629)
0812 00:05:30.745796 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:30.745801 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:30.745989 (+ 188us) server_negotiation.cc:407] Connection header received
0812 00:05:30.746029 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:30.746031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:30.746044 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:30.746115 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:30.746368 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.747494 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.748591 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.749276 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.749673 (+ 397us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:30.749728 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:30.749851 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 00:05:30.749884 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":84,"threads_started":1}
I20260812 00:05:30.750407 24968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dafdf32ca8fe431f99e62456d03f99e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:30.750485 25063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.745634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60910 (local address 127.19.59.65:35901)
0812 00:05:30.745832 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:30.745836 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:30.745848 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:05:30.745889 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:30.745891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:30.745907 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:30.746341 (+ 434us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:30.746437 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.747500 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.748701 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:30.749336 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:30.749416 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:30.749469 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:30.750042 (+ 573us) server_negotiation.cc:299] Negotiation successful
0812 00:05:30.750085 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":87,"threads_started":1}
I20260812 00:05:30.750878 24815 tablet_service.cc:1467] Processing CreateTablet for tablet dafdf32ca8fe431f99e62456d03f99e9 (DEFAULT_TABLE table=test-table [id=497976edc4f8498ab4b072191a6d16a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:30.751080 24667 tablet_service.cc:1467] Processing CreateTablet for tablet dafdf32ca8fe431f99e62456d03f99e9 (DEFAULT_TABLE table=test-table [id=497976edc4f8498ab4b072191a6d16a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:30.751185 24815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dafdf32ca8fe431f99e62456d03f99e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:30.751348 24667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dafdf32ca8fe431f99e62456d03f99e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:30.754025 25064 tablet_bootstrap.cc:492] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a: Bootstrap starting.
I20260812 00:05:30.754458 25065 tablet_bootstrap.cc:492] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb: Bootstrap starting.
I20260812 00:05:30.754660 25064 tablet_bootstrap.cc:654] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:30.754663 25066 tablet_bootstrap.cc:492] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332: Bootstrap starting.
I20260812 00:05:30.755312 25066 tablet_bootstrap.cc:654] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:30.755316 25064 log.cc:824] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:30.755903 25066 log.cc:824] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:30.756137 25064 tablet_bootstrap.cc:492] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a: No bootstrap required, opened a new log
I20260812 00:05:30.756212 25064 ts_tablet_manager.cc:1397] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:30.756726 25066 tablet_bootstrap.cc:492] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332: No bootstrap required, opened a new log
I20260812 00:05:30.756812 25066 ts_tablet_manager.cc:1397] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:30.756839 25065 tablet_bootstrap.cc:654] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:30.757367 25065 log.cc:824] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:30.758180 25065 tablet_bootstrap.cc:492] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb: No bootstrap required, opened a new log
I20260812 00:05:30.758255 25065 ts_tablet_manager.cc:1397] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 00:05:30.758380 25064 raft_consensus.cc:348] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e51970ee6b4817bf811ff18b92f332" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42629 } } peers { permanent_uuid: "8f289c4fba624892b86e7f3cce63325a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33583 } } peers { permanent_uuid: "2ced21ad3ac1476ca3664f62f7410ecb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 35901 } }
I20260812 00:05:30.758428 25066 raft_consensus.cc:348] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e51970ee6b4817bf811ff18b92f332" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42629 } } peers { permanent_uuid: "8f289c4fba624892b86e7f3cce63325a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33583 } } peers { permanent_uuid: "2ced21ad3ac1476ca3664f62f7410ecb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 35901 } }
I20260812 00:05:30.758540 25064 raft_consensus.cc:374] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:30.758570 25066 raft_consensus.cc:374] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:30.758579 25064 raft_consensus.cc:729] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f289c4fba624892b86e7f3cce63325a, State: Initialized, Role: FOLLOWER
I20260812 00:05:30.758613 25066 raft_consensus.cc:729] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22e51970ee6b4817bf811ff18b92f332, State: Initialized, Role: FOLLOWER
I20260812 00:05:30.758689 25064 consensus_queue.cc:260] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e51970ee6b4817bf811ff18b92f332" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42629 } } peers { permanent_uuid: "8f289c4fba624892b86e7f3cce63325a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33583 } } peers { permanent_uuid: "2ced21ad3ac1476ca3664f62f7410ecb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 35901 } }
I20260812 00:05:30.758770 25066 consensus_queue.cc:260] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e51970ee6b4817bf811ff18b92f332" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42629 } } peers { permanent_uuid: "8f289c4fba624892b86e7f3cce63325a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33583 } } peers { permanent_uuid: "2ced21ad3ac1476ca3664f62f7410ecb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 35901 } }
I20260812 00:05:30.759006 25064 ts_tablet_manager.cc:1428] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:05:30.759126 25043 heartbeater.cc:503] Master 127.19.59.126:46387 was elected leader, sending a full tablet report...
I20260812 00:05:30.759070 25066 ts_tablet_manager.cc:1428] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:05:30.759119 24893 heartbeater.cc:503] Master 127.19.59.126:46387 was elected leader, sending a full tablet report...
I20260812 00:05:30.760218 25065 raft_consensus.cc:348] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e51970ee6b4817bf811ff18b92f332" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42629 } } peers { permanent_uuid: "8f289c4fba624892b86e7f3cce63325a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33583 } } peers { permanent_uuid: "2ced21ad3ac1476ca3664f62f7410ecb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 35901 } }
I20260812 00:05:30.760357 25065 raft_consensus.cc:374] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:30.760380 25065 raft_consensus.cc:729] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ced21ad3ac1476ca3664f62f7410ecb, State: Initialized, Role: FOLLOWER
I20260812 00:05:30.760468 25065 consensus_queue.cc:260] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e51970ee6b4817bf811ff18b92f332" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42629 } } peers { permanent_uuid: "8f289c4fba624892b86e7f3cce63325a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33583 } } peers { permanent_uuid: "2ced21ad3ac1476ca3664f62f7410ecb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 35901 } }
I20260812 00:05:30.760649 25065 ts_tablet_manager.cc:1428] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:05:30.760721 24744 heartbeater.cc:503] Master 127.19.59.126:46387 was elected leader, sending a full tablet report...
W20260812 00:05:30.811424 24894 tablet.cc:2369] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:05:30.909416 24745 tablet.cc:2369] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:05:30.966708 25045 tablet.cc:2369] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:05:31.064586 25071 raft_consensus.cc:482] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:31.064774 25071 raft_consensus.cc:504] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e51970ee6b4817bf811ff18b92f332" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42629 } } peers { permanent_uuid: "8f289c4fba624892b86e7f3cce63325a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33583 } } peers { permanent_uuid: "2ced21ad3ac1476ca3664f62f7410ecb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 35901 } }
I20260812 00:05:31.065169 25071 leader_election.cc:288] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22e51970ee6b4817bf811ff18b92f332 (127.19.59.66:42629), 2ced21ad3ac1476ca3664f62f7410ecb (127.19.59.65:35901)
I20260812 00:05:31.065686 25072 raft_consensus.cc:482] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:31.065798 25072 raft_consensus.cc:504] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e51970ee6b4817bf811ff18b92f332" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42629 } } peers { permanent_uuid: "8f289c4fba624892b86e7f3cce63325a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33583 } } peers { permanent_uuid: "2ced21ad3ac1476ca3664f62f7410ecb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 35901 } }
I20260812 00:05:31.066382 25072 leader_election.cc:288] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f289c4fba624892b86e7f3cce63325a (127.19.59.67:33583), 2ced21ad3ac1476ca3664f62f7410ecb (127.19.59.65:35901)
I20260812 00:05:31.068795 25046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.065390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:35901 (local address 127.19.59.67:55277)
0812 00:05:31.065475 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.065487 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:31.065533 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:31.065728 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:31.065728 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:31.065731 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:31.065821 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:31.065824 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.066677 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.066678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:31.067815 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:31.067817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.068537 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.068538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:31.068618 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:31.068622 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:31.068669 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:05:31.068717 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 00:05:31.068995 25074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.065390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:42629 (local address 127.19.59.67:55307)
0812 00:05:31.065702 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.065715 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:31.065788 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:31.066038 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:31.066038 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:31.066040 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:31.066113 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:31.066115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.066952 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.066953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:31.067950 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:31.067952 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.068685 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.068685 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:31.068750 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:31.068794 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 00:05:31.068859 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 00:05:31.068910 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":143,"thread_start_us":146,"threads_started":1}
I20260812 00:05:31.068998 25062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.065464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:55307 (local address 127.19.59.66:42629)
0812 00:05:31.065536 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:31.065538 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:31.065763 (+ 225us) server_negotiation.cc:407] Connection header received
0812 00:05:31.065961 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:31.065963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:31.065973 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:31.066033 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:31.066172 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.066774 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.068032 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.068584 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.068624 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:31.068631 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:31.068898 (+ 267us) server_negotiation.cc:299] Negotiation successful
0812 00:05:31.068936 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":12,"server-negotiator.queue_time_us":43}
I20260812 00:05:31.069331 25063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.065475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:55277 (local address 127.19.59.65:35901)
0812 00:05:31.065538 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:31.065539 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:31.065591 (+ 52us) server_negotiation.cc:407] Connection header received
0812 00:05:31.065623 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:31.065624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:31.065635 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:31.065689 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:31.065938 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.066592 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.067905 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.068412 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.068498 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:31.068507 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:31.069237 (+ 730us) server_negotiation.cc:299] Negotiation successful
0812 00:05:31.069272 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:05:31.069391 24839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dafdf32ca8fe431f99e62456d03f99e9" candidate_uuid: "8f289c4fba624892b86e7f3cce63325a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22e51970ee6b4817bf811ff18b92f332" is_pre_election: true
I20260812 00:05:31.069504 24839 raft_consensus.cc:2454] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f289c4fba624892b86e7f3cce63325a in term 0.
I20260812 00:05:31.069577 24693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dafdf32ca8fe431f99e62456d03f99e9" candidate_uuid: "8f289c4fba624892b86e7f3cce63325a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ced21ad3ac1476ca3664f62f7410ecb" is_pre_election: true
I20260812 00:05:31.069693 24917 leader_election.cc:302] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22e51970ee6b4817bf811ff18b92f332, 8f289c4fba624892b86e7f3cce63325a; no voters:
I20260812 00:05:31.069720 24693 raft_consensus.cc:2454] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f289c4fba624892b86e7f3cce63325a in term 0.
I20260812 00:05:31.069840 25071 raft_consensus.cc:2781] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:31.069893 25071 raft_consensus.cc:482] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:31.069921 25071 raft_consensus.cc:3037] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:31.069918 24895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.066235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:33583 (local address 127.19.59.66:41731)
0812 00:05:31.066276 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.066283 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:31.066314 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:31.066684 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:31.066684 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:31.066686 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:31.066748 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:31.066749 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.067523 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.067524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:31.068571 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:31.068574 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.069669 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.069670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:31.069739 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:31.069742 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:31.069789 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:05:31.069853 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":1}
I20260812 00:05:31.070161 25061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.066523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:41731 (local address 127.19.59.67:33583)
0812 00:05:31.066565 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:31.066566 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:31.066573 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:31.066591 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:31.066592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:31.066600 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:31.066645 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:31.066824 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.067436 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.068673 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.069565 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.069630 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:31.069638 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:31.070072 (+ 434us) server_negotiation.cc:299] Negotiation successful
0812 00:05:31.070115 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:05:31.070181 25076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.066522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:35901 (local address 127.19.59.66:50413)
0812 00:05:31.066841 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.066850 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:31.066885 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:31.067186 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:31.067187 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:31.067189 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:31.067251 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:31.067252 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.068048 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.068049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:31.069117 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:31.069119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.069935 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.069937 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:31.070004 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:31.070007 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:31.070059 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 00:05:31.070101 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":61,"threads_started":1}
I20260812 00:05:31.070366 25077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.066940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:50413 (local address 127.19.59.65:35901)
0812 00:05:31.067045 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:31.067046 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:31.067054 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:31.067074 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:31.067074 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:31.067083 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:31.067144 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:31.067320 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.067951 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.069263 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.069764 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.069877 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:31.069885 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:31.070260 (+ 375us) server_negotiation.cc:299] Negotiation successful
0812 00:05:31.070299 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":58,"threads_started":1}
I20260812 00:05:31.070361 24988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dafdf32ca8fe431f99e62456d03f99e9" candidate_uuid: "22e51970ee6b4817bf811ff18b92f332" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f289c4fba624892b86e7f3cce63325a" is_pre_election: true
I20260812 00:05:31.070773 24693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dafdf32ca8fe431f99e62456d03f99e9" candidate_uuid: "22e51970ee6b4817bf811ff18b92f332" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ced21ad3ac1476ca3664f62f7410ecb" is_pre_election: true
I20260812 00:05:31.070842 24693 raft_consensus.cc:2454] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22e51970ee6b4817bf811ff18b92f332 in term 0.
I20260812 00:05:31.070916 25071 raft_consensus.cc:504] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e51970ee6b4817bf811ff18b92f332" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42629 } } peers { permanent_uuid: "8f289c4fba624892b86e7f3cce63325a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33583 } } peers { permanent_uuid: "2ced21ad3ac1476ca3664f62f7410ecb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 35901 } }
I20260812 00:05:31.071036 24766 leader_election.cc:302] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22e51970ee6b4817bf811ff18b92f332, 2ced21ad3ac1476ca3664f62f7410ecb; no voters:
I20260812 00:05:31.071099 25071 leader_election.cc:288] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [CANDIDATE]: Term 1 election: Requested vote from peers 22e51970ee6b4817bf811ff18b92f332 (127.19.59.66:42629), 2ced21ad3ac1476ca3664f62f7410ecb (127.19.59.65:35901)
I20260812 00:05:31.071197 25072 raft_consensus.cc:2781] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:31.071266 25072 raft_consensus.cc:482] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:31.071111 24988 raft_consensus.cc:2379] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22e51970ee6b4817bf811ff18b92f332 in current term 1: Already voted for candidate 8f289c4fba624892b86e7f3cce63325a in this term.
I20260812 00:05:31.071305 25072 raft_consensus.cc:3037] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:31.071336 24693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dafdf32ca8fe431f99e62456d03f99e9" candidate_uuid: "8f289c4fba624892b86e7f3cce63325a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ced21ad3ac1476ca3664f62f7410ecb"
I20260812 00:05:31.071393 24693 raft_consensus.cc:3037] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:31.071271 24839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dafdf32ca8fe431f99e62456d03f99e9" candidate_uuid: "8f289c4fba624892b86e7f3cce63325a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22e51970ee6b4817bf811ff18b92f332"
I20260812 00:05:31.072237 24693 raft_consensus.cc:2454] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f289c4fba624892b86e7f3cce63325a in term 1.
I20260812 00:05:31.072238 25072 raft_consensus.cc:504] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e51970ee6b4817bf811ff18b92f332" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42629 } } peers { permanent_uuid: "8f289c4fba624892b86e7f3cce63325a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33583 } } peers { permanent_uuid: "2ced21ad3ac1476ca3664f62f7410ecb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 35901 } }
I20260812 00:05:31.072393 25072 leader_election.cc:288] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [CANDIDATE]: Term 1 election: Requested vote from peers 8f289c4fba624892b86e7f3cce63325a (127.19.59.67:33583), 2ced21ad3ac1476ca3664f62f7410ecb (127.19.59.65:35901)
I20260812 00:05:31.072400 24839 raft_consensus.cc:2379] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8f289c4fba624892b86e7f3cce63325a in current term 1: Already voted for candidate 22e51970ee6b4817bf811ff18b92f332 in this term.
I20260812 00:05:31.072451 24916 leader_election.cc:302] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ced21ad3ac1476ca3664f62f7410ecb, 8f289c4fba624892b86e7f3cce63325a; no voters:
I20260812 00:05:31.072580 24988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dafdf32ca8fe431f99e62456d03f99e9" candidate_uuid: "22e51970ee6b4817bf811ff18b92f332" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f289c4fba624892b86e7f3cce63325a"
I20260812 00:05:31.072681 24988 raft_consensus.cc:2379] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22e51970ee6b4817bf811ff18b92f332 in current term 1: Already voted for candidate 8f289c4fba624892b86e7f3cce63325a in this term.
I20260812 00:05:31.072726 24693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dafdf32ca8fe431f99e62456d03f99e9" candidate_uuid: "22e51970ee6b4817bf811ff18b92f332" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ced21ad3ac1476ca3664f62f7410ecb"
I20260812 00:05:31.072809 24693 raft_consensus.cc:2379] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22e51970ee6b4817bf811ff18b92f332 in current term 1: Already voted for candidate 8f289c4fba624892b86e7f3cce63325a in this term.
I20260812 00:05:31.072835 25071 raft_consensus.cc:2781] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:31.072974 25071 raft_consensus.cc:686] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [term 1 LEADER]: Becoming Leader. State: Replica: 8f289c4fba624892b86e7f3cce63325a, State: Running, Role: LEADER
I20260812 00:05:31.073037 24766 leader_election.cc:302] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22e51970ee6b4817bf811ff18b92f332; no voters: 2ced21ad3ac1476ca3664f62f7410ecb, 8f289c4fba624892b86e7f3cce63325a
I20260812 00:05:31.073081 25071 consensus_queue.cc:237] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e51970ee6b4817bf811ff18b92f332" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42629 } } peers { permanent_uuid: "8f289c4fba624892b86e7f3cce63325a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33583 } } peers { permanent_uuid: "2ced21ad3ac1476ca3664f62f7410ecb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 35901 } }
I20260812 00:05:31.073141 25072 raft_consensus.cc:2726] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 00:05:31.074024 24523 catalog_manager.cc:5495] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f289c4fba624892b86e7f3cce63325a (127.19.59.67). New cstate: current_term: 1 leader_uuid: "8f289c4fba624892b86e7f3cce63325a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e51970ee6b4817bf811ff18b92f332" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f289c4fba624892b86e7f3cce63325a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ced21ad3ac1476ca3664f62f7410ecb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 35901 } health_report { overall_health: UNKNOWN } } }
I20260812 00:05:31.100466 25061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.098159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55318 (local address 127.19.59.67:33583)
0812 00:05:31.098227 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:31.098229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:31.098239 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:31.098296 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:31.098297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:31.098315 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:31.098400 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:31.098560 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.099002 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.099718 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:31.099908 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:31.099987 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:31.100144 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:31.100243 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:31.100334 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:31.100353 (+ 19us) server_negotiation.cc:299] Negotiation successful
0812 00:05:31.100370 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 00:05:31.102197 24693 raft_consensus.cc:1261] T dafdf32ca8fe431f99e62456d03f99e9 P 2ced21ad3ac1476ca3664f62f7410ecb [term 1 FOLLOWER]: Refusing update from remote peer 8f289c4fba624892b86e7f3cce63325a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:31.102285 24839 raft_consensus.cc:1261] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [term 1 FOLLOWER]: Refusing update from remote peer 8f289c4fba624892b86e7f3cce63325a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:31.102519 25078 consensus_queue.cc:1035] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ced21ad3ac1476ca3664f62f7410ecb" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 35901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:31.102662 25071 consensus_queue.cc:1035] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [LEADER]: Connected to new peer: Peer: permanent_uuid: "22e51970ee6b4817bf811ff18b92f332" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:31.104996 25081 mvcc.cc:205] Tried to move back new op lower bound from 7317475864991895552 to 7317475864875937792. Current Snapshot: MvccSnapshot[applied={T|T < 7317475864991895552}]
I20260812 00:05:31.105023 25083 mvcc.cc:205] Tried to move back new op lower bound from 7317475864991895552 to 7317475864875937792. Current Snapshot: MvccSnapshot[applied={T|T < 7317475864991895552}]
I20260812 00:05:31.105286 25084 mvcc.cc:205] Tried to move back new op lower bound from 7317475864991895552 to 7317475864875937792. Current Snapshot: MvccSnapshot[applied={T|T < 7317475864991895552}]
I20260812 00:05:31.107764 24522 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:31.107847 24522 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:31.108706 24522 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3f54999f6c964f3e9ee55a57c5b46f70: Sending DeleteTablet for 3 replicas of tablet dafdf32ca8fe431f99e62456d03f99e9
I20260812 00:05:31.109047 24815 tablet_service.cc:1514] Processing DeleteTablet for tablet dafdf32ca8fe431f99e62456d03f99e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:31 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:58316
I20260812 00:05:31.109265 24968 tablet_service.cc:1514] Processing DeleteTablet for tablet dafdf32ca8fe431f99e62456d03f99e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:31 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:55310
I20260812 00:05:31.109342 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 24598
I20260812 00:05:31.109484 25093 tablet_replica.cc:330] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332: stopping tablet replica
I20260812 00:05:31.109526 24667 tablet_service.cc:1514] Processing DeleteTablet for tablet dafdf32ca8fe431f99e62456d03f99e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:31 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:60910
I20260812 00:05:31.109581 25093 raft_consensus.cc:2229] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:31.109673 25093 raft_consensus.cc:2258] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:31.111933 25094 tablet_replica.cc:330] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a: stopping tablet replica
I20260812 00:05:31.112061 25094 raft_consensus.cc:2229] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:31.112175 25094 raft_consensus.cc:2258] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:31.112501 25093 ts_tablet_manager.cc:1905] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:31.114236 25094 ts_tablet_manager.cc:1905] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:31.115617 25093 ts_tablet_manager.cc:1918] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:31.115618 25094 ts_tablet_manager.cc:1918] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:31.115694 25094 log.cc:1196] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/dafdf32ca8fe431f99e62456d03f99e9
I20260812 00:05:31.115797 25093 log.cc:1196] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/dafdf32ca8fe431f99e62456d03f99e9
I20260812 00:05:31.116266 25093 ts_tablet_manager.cc:1939] T dafdf32ca8fe431f99e62456d03f99e9 P 22e51970ee6b4817bf811ff18b92f332: Deleting consensus metadata
I20260812 00:05:31.116444 25094 ts_tablet_manager.cc:1939] T dafdf32ca8fe431f99e62456d03f99e9 P 8f289c4fba624892b86e7f3cce63325a: Deleting consensus metadata
I20260812 00:05:31.116776 24507 catalog_manager.cc:4841] TS 22e51970ee6b4817bf811ff18b92f332 (127.19.59.66:42629): tablet dafdf32ca8fe431f99e62456d03f99e9 (table test-table [id=497976edc4f8498ab4b072191a6d16a4]) successfully deleted
I20260812 00:05:31.116935 24508 catalog_manager.cc:4841] TS 8f289c4fba624892b86e7f3cce63325a (127.19.59.67:33583): tablet dafdf32ca8fe431f99e62456d03f99e9 (table test-table [id=497976edc4f8498ab4b072191a6d16a4]) successfully deleted
W20260812 00:05:31.118822 24506 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:35901 (error 108)
I20260812 00:05:31.119123 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 24749
I20260812 00:05:31.120823 25057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.119209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:35901 (local address 127.0.0.1:60914)
0812 00:05:31.120739 (+ 1530us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.120783 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:35901: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1508}
W20260812 00:05:31.123221 24506 catalog_manager.cc:4584] TS 2ced21ad3ac1476ca3664f62f7410ecb (127.19.59.65:35901): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dafdf32ca8fe431f99e62456d03f99e9: Network error: Client connection negotiation failed: client connection to 127.19.59.65:35901: connect: Connection refused (error 111)
I20260812 00:05:31.126987 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 24898
I20260812 00:05:31.135941 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 24486
2026-08-12T00:05:31Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2308 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T00:05:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:31Z Disabled control of system clock
I20260812 00:05:31.165634 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:46083
--webserver_interface=127.19.59.126
--webserver_port=0
--builtin_ntp_servers=127.19.59.84:33771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:46083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 00:05:31.242703 25100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:31.242926 25100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:31.242964 25100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:31.244066 25100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:31.244130 25100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:31.244150 25100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:31.244172 25100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:31.244201 25100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:31.245530 25100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:46083
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:46083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:31.245800 25100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:31.246105 25100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:31.250715 25108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:31.250682 25106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:31.250758 25105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:31.251029 25100 server_base.cc:1034] running on GCE node
I20260812 00:05:31.251266 25100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:31.251533 25100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:31.252700 25100 hybrid_clock.cc:648] HybridClock initialized: now 1786493131252685 us; error 26 us; skew 500 ppm
I20260812 00:05:31.253937 25100 webserver.cc:460] Webserver started at http://127.19.59.126:39483/ using document root <none> and password file <none>
I20260812 00:05:31.254174 25100 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:31.254241 25100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:31.254405 25100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:31.255393 25100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "3e304fe6e1eb4611914368ea358f1613"
format_stamp: "Formatted at 2026-08-12 00:05:31 on dist-test-slave-6nmv"
server_key: "b9167328f5f291b1426d9cdb974cdaec"
server_key_iv: "8aa3cf7445e3fc7528159ab1be81de16"
server_key_version: "encryptionkey@0"
I20260812 00:05:31.255731 25100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "3e304fe6e1eb4611914368ea358f1613"
format_stamp: "Formatted at 2026-08-12 00:05:31 on dist-test-slave-6nmv"
server_key: "b9167328f5f291b1426d9cdb974cdaec"
server_key_iv: "8aa3cf7445e3fc7528159ab1be81de16"
server_key_version: "encryptionkey@0"
I20260812 00:05:31.256966 25100 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:05:31.257597 25116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:31.257767 25100 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:31.257876 25100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "3e304fe6e1eb4611914368ea358f1613"
format_stamp: "Formatted at 2026-08-12 00:05:31 on dist-test-slave-6nmv"
server_key: "b9167328f5f291b1426d9cdb974cdaec"
server_key_iv: "8aa3cf7445e3fc7528159ab1be81de16"
server_key_version: "encryptionkey@0"
I20260812 00:05:31.257962 25100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:31.260815 25100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:31.261034 25100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:31.261159 25100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:31.264858 25100 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:46083
I20260812 00:05:31.264892 25177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:46083 every 8 connection(s)
I20260812 00:05:31.265173 25100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:31.265750 25178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:31.268198 25178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613: Bootstrap starting.
I20260812 00:05:31.268671 25178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:31.268893 25178 log.cc:824] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:31.269481 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 25100
I20260812 00:05:31.269600 25178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613: No bootstrap required, opened a new log
I20260812 00:05:31.269608 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:31.269791 19693 external_mini_cluster.cc:1428] Setting key 933c5902dfd8bb9b6847b6f1bd66f0c6
I20260812 00:05:31.271427 25178 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e304fe6e1eb4611914368ea358f1613" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46083 } }
I20260812 00:05:31.271579 25178 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:31.271631 25178 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e304fe6e1eb4611914368ea358f1613, State: Initialized, Role: FOLLOWER
I20260812 00:05:31.272145 25178 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e304fe6e1eb4611914368ea358f1613" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46083 } }
I20260812 00:05:31.272289 25178 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:31.272329 25178 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:31.272379 25178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:31.272982 25178 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e304fe6e1eb4611914368ea358f1613" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46083 } }
I20260812 00:05:31.273069 25178 leader_election.cc:302] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e304fe6e1eb4611914368ea358f1613; no voters:
I20260812 00:05:31.273113 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.270326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58752 (local address 127.19.59.126:46083)
0812 00:05:31.270537 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:31.270543 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:31.270566 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:05:31.271407 (+ 841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:31.271413 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:31.271444 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:31.271548 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:31.272337 (+ 789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:31.272342 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:31.272342 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:31.272351 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:31.272407 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:31.272425 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:31.272510 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:31.272588 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 00:05:31.272650 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":76,"threads_started":1}
I20260812 00:05:31.273244 25178 leader_election.cc:288] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:31.273396 25186 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:31.273487 25178 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:31.273514 25186 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [term 1 LEADER]: Becoming Leader. State: Replica: 3e304fe6e1eb4611914368ea358f1613, State: Running, Role: LEADER
I20260812 00:05:31.273587 25186 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e304fe6e1eb4611914368ea358f1613" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46083 } }
I20260812 00:05:31.273941 25188 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e304fe6e1eb4611914368ea358f1613" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e304fe6e1eb4611914368ea358f1613" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46083 } } }
I20260812 00:05:31.274052 25188 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:31.273940 25185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e304fe6e1eb4611914368ea358f1613. Latest consensus state: current_term: 1 leader_uuid: "3e304fe6e1eb4611914368ea358f1613" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e304fe6e1eb4611914368ea358f1613" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46083 } } }
I20260812 00:05:31.274201 25185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:31.274308 25196 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:31.274740 25196 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:31.278650 25196 catalog_manager.cc:1347] Generated new cluster ID: 0d19f6ce0c86432186b7ec33ef5070cd
I20260812 00:05:31.278714 25196 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:31.292577 25196 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:31.292749 25196 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:31.294446 25196 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613: Generated new TSK 0
I20260812 00:05:31.294602 25196 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:05:31.296496 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46083
--builtin_ntp_servers=127.19.59.84:33771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 00:05:31.374760 25207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:31.375003 25207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:31.375027 25207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:31.376209 25207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:31.376250 25207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:31.376276 25207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:05:31.377581 25207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:31.377838 25207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:31.378139 25207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:31.383070 25212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:31.383092 25215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:31.383298 25207 server_base.cc:1034] running on GCE node
W20260812 00:05:31.383082 25213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:31.383541 25207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:31.383773 25207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:31.384934 25207 hybrid_clock.cc:648] HybridClock initialized: now 1786493131384914 us; error 53 us; skew 500 ppm
I20260812 00:05:31.386320 25207 webserver.cc:460] Webserver started at http://127.19.59.65:39291/ using document root <none> and password file <none>
I20260812 00:05:31.386557 25207 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:31.386623 25207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:31.386749 25207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:31.387696 25207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "a05b75767cc04e90ace81ba326331b69"
format_stamp: "Formatted at 2026-08-12 00:05:31 on dist-test-slave-6nmv"
server_key: "cc6b8da659840c47e5f5cec2575c5e42"
server_key_iv: "387ee1eb96da9fed83822d6b1cd5d5a0"
server_key_version: "encryptionkey@0"
I20260812 00:05:31.388041 25207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "a05b75767cc04e90ace81ba326331b69"
format_stamp: "Formatted at 2026-08-12 00:05:31 on dist-test-slave-6nmv"
server_key: "cc6b8da659840c47e5f5cec2575c5e42"
server_key_iv: "387ee1eb96da9fed83822d6b1cd5d5a0"
server_key_version: "encryptionkey@0"
I20260812 00:05:31.389338 25207 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:05:31.390092 25222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:31.390304 25207 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:31.390398 25207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "a05b75767cc04e90ace81ba326331b69"
format_stamp: "Formatted at 2026-08-12 00:05:31 on dist-test-slave-6nmv"
server_key: "cc6b8da659840c47e5f5cec2575c5e42"
server_key_iv: "387ee1eb96da9fed83822d6b1cd5d5a0"
server_key_version: "encryptionkey@0"
I20260812 00:05:31.390471 25207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:31.394395 25207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:31.394608 25207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:31.394701 25207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:31.394851 25207 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:31.395102 25207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:31.395133 25207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:31.395151 25207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:31.395164 25207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:31.400903 25207 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:44515
I20260812 00:05:31.400979 25349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:44515 every 8 connection(s)
I20260812 00:05:31.401279 25207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:05:31.404228 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.401983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:58183 (local address 127.19.59.126:46083)
0812 00:05:31.402047 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:31.402049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:31.402291 (+ 242us) server_negotiation.cc:407] Connection header received
0812 00:05:31.402806 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:31.402807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:31.402814 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:31.402870 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:31.403995 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:31.403996 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:31.403997 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:31.404002 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:31.404019 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:31.404023 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:31.404075 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:31.404146 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:05:31.404159 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 00:05:31.404408 25352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.402011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:46083 (local address 127.19.59.65:58183)
0812 00:05:31.402187 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.402216 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:31.402686 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:31.402939 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:31.402943 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:31.402959 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:31.403828 (+ 869us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:31.403829 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:31.403855 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:31.403882 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:31.404071 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:31.404076 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:31.404079 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:31.404155 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 00:05:31.404211 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":83,"threads_started":1}
I20260812 00:05:31.404923 25350 heartbeater.cc:347] Connected to a master server at 127.19.59.126:46083
I20260812 00:05:31.405018 25350 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:31.405158 25350 heartbeater.cc:511] Master 127.19.59.126:46083 requested a full tablet report, sending...
I20260812 00:05:31.405637 25135 ts_manager.cc:194] Registered new tserver with Master: a05b75767cc04e90ace81ba326331b69 (127.19.59.65:44515)
I20260812 00:05:31.411361 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 25207
I20260812 00:05:31.411440 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:31.411643 19693 external_mini_cluster.cc:1428] Setting key e641a78c73ae266dcfdfe4e87d767468
I20260812 00:05:31.412537 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46083
--builtin_ntp_servers=127.19.59.84:33771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 00:05:31.486735 25353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:31.486929 25353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:31.486950 25353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:31.488004 25353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:31.488054 25353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:31.488075 25353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:05:31.489137 25353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:31.489281 25353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:31.489470 25353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:31.494071 25358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:31.494099 25361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:31.494102 25359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:31.494222 25353 server_base.cc:1034] running on GCE node
I20260812 00:05:31.494549 25353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:31.494742 25353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:31.495877 25353 hybrid_clock.cc:648] HybridClock initialized: now 1786493131495869 us; error 29 us; skew 500 ppm
I20260812 00:05:31.496853 25353 webserver.cc:460] Webserver started at http://127.19.59.66:37017/ using document root <none> and password file <none>
I20260812 00:05:31.497021 25353 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:31.497056 25353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:31.497133 25353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:31.498070 25353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "fd8bb640a0414cf992980a251652b5b2"
format_stamp: "Formatted at 2026-08-12 00:05:31 on dist-test-slave-6nmv"
server_key: "0d032a3708854cab40e3ce4cccd55083"
server_key_iv: "f13f9305e6a02e8281f898df4de99d79"
server_key_version: "encryptionkey@0"
I20260812 00:05:31.498406 25353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "fd8bb640a0414cf992980a251652b5b2"
format_stamp: "Formatted at 2026-08-12 00:05:31 on dist-test-slave-6nmv"
server_key: "0d032a3708854cab40e3ce4cccd55083"
server_key_iv: "f13f9305e6a02e8281f898df4de99d79"
server_key_version: "encryptionkey@0"
I20260812 00:05:31.499568 25353 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:31.500274 25370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:31.500456 25353 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:31.500545 25353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "fd8bb640a0414cf992980a251652b5b2"
format_stamp: "Formatted at 2026-08-12 00:05:31 on dist-test-slave-6nmv"
server_key: "0d032a3708854cab40e3ce4cccd55083"
server_key_iv: "f13f9305e6a02e8281f898df4de99d79"
server_key_version: "encryptionkey@0"
I20260812 00:05:31.500623 25353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:31.503835 25353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:31.504105 25353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:31.504238 25353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:31.504437 25353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:31.504711 25353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:31.504760 25353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:31.504796 25353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:31.504823 25353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:31.510447 25353 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:43467
I20260812 00:05:31.510491 25502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:43467 every 8 connection(s)
I20260812 00:05:31.510788 25353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:31.513724 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.511430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:60857 (local address 127.19.59.126:46083)
0812 00:05:31.511518 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:31.511521 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:31.511778 (+ 257us) server_negotiation.cc:407] Connection header received
0812 00:05:31.512218 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:31.512219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:31.512225 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:31.512287 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:31.513478 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:31.513479 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:31.513480 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:31.513484 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:31.513503 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:31.513507 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:31.513561 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:31.513637 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 00:05:31.513652 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 00:05:31.513917 25505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.511421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:46083 (local address 127.19.59.66:60857)
0812 00:05:31.511633 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.511687 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:31.512115 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:31.512347 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:31.512350 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:31.512359 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:31.513323 (+ 964us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:31.513324 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:31.513349 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:31.513374 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:31.513558 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:31.513563 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:31.513566 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:31.513641 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:05:31.513698 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":117,"threads_started":1}
I20260812 00:05:31.514395 25503 heartbeater.cc:347] Connected to a master server at 127.19.59.126:46083
I20260812 00:05:31.514499 25503 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:31.514633 25503 heartbeater.cc:511] Master 127.19.59.126:46083 requested a full tablet report, sending...
I20260812 00:05:31.514977 25135 ts_manager.cc:194] Registered new tserver with Master: fd8bb640a0414cf992980a251652b5b2 (127.19.59.66:43467)
I20260812 00:05:31.517524 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 25353
I20260812 00:05:31.517633 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:31.517874 19693 external_mini_cluster.cc:1428] Setting key 2729001d22af66816ac9e466e6ff7aa9
I20260812 00:05:31.518797 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46083
--builtin_ntp_servers=127.19.59.84:33771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 00:05:31.599287 25506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:31.599457 25506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:31.599478 25506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:31.600494 25506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:31.600529 25506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:31.600551 25506 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:05:31.601629 25506 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:31.601787 25506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:31.602028 25506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:31.606619 25511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:31.606647 25512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:31.606623 25514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:31.606932 25506 server_base.cc:1034] running on GCE node
I20260812 00:05:31.607108 25506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:31.607319 25506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:31.608474 25506 hybrid_clock.cc:648] HybridClock initialized: now 1786493131608459 us; error 26 us; skew 500 ppm
I20260812 00:05:31.609630 25506 webserver.cc:460] Webserver started at http://127.19.59.67:44539/ using document root <none> and password file <none>
I20260812 00:05:31.609951 25506 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:31.610014 25506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:31.610157 25506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:31.611073 25506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "7b3dcef10f064e439fc94fd614c437e1"
format_stamp: "Formatted at 2026-08-12 00:05:31 on dist-test-slave-6nmv"
server_key: "06b2587a505f7744ef5955dab2e2e20e"
server_key_iv: "57c1fbf372d2d3d904e847ff6f320cb3"
server_key_version: "encryptionkey@0"
I20260812 00:05:31.611406 25506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "7b3dcef10f064e439fc94fd614c437e1"
format_stamp: "Formatted at 2026-08-12 00:05:31 on dist-test-slave-6nmv"
server_key: "06b2587a505f7744ef5955dab2e2e20e"
server_key_iv: "57c1fbf372d2d3d904e847ff6f320cb3"
server_key_version: "encryptionkey@0"
I20260812 00:05:31.612660 25506 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:05:31.613605 25520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:31.613788 25506 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:31.613929 25506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "7b3dcef10f064e439fc94fd614c437e1"
format_stamp: "Formatted at 2026-08-12 00:05:31 on dist-test-slave-6nmv"
server_key: "06b2587a505f7744ef5955dab2e2e20e"
server_key_iv: "57c1fbf372d2d3d904e847ff6f320cb3"
server_key_version: "encryptionkey@0"
I20260812 00:05:31.614053 25506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:31.617086 25506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:31.617338 25506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:31.617473 25506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:31.617695 25506 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:31.617996 25506 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:31.618054 25506 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:31.618089 25506 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:31.618114 25506 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:31.623597 25506 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:41741
I20260812 00:05:31.623633 25651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:41741 every 8 connection(s)
I20260812 00:05:31.623939 25506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:31.626900 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.624696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:55069 (local address 127.19.59.126:46083)
0812 00:05:31.624741 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:31.624743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:31.624977 (+ 234us) server_negotiation.cc:407] Connection header received
0812 00:05:31.625459 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:31.625460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:31.625470 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:31.625520 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:31.626657 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:31.626658 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:31.626658 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:31.626663 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:31.626678 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:31.626683 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:31.626733 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:31.626813 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 00:05:31.626831 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:05:31.627143 25654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.624660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:46083 (local address 127.19.59.67:55069)
0812 00:05:31.624845 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.624872 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:31.625335 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:31.625594 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:31.625597 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:31.625606 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:31.626503 (+ 897us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:31.626503 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:31.626527 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:31.626552 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:31.626729 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:31.626734 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:31.626737 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:31.626823 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 00:05:31.626938 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":87,"threads_started":1}
I20260812 00:05:31.627629 25652 heartbeater.cc:347] Connected to a master server at 127.19.59.126:46083
I20260812 00:05:31.627703 25652 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:31.627861 25652 heartbeater.cc:511] Master 127.19.59.126:46083 requested a full tablet report, sending...
I20260812 00:05:31.628222 25135 ts_manager.cc:194] Registered new tserver with Master: 7b3dcef10f064e439fc94fd614c437e1 (127.19.59.67:41741)
I20260812 00:05:31.634011 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 25506
I20260812 00:05:31.634100 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:31.634245 19693 external_mini_cluster.cc:1428] Setting key 2c9872507a755d6ec5737ff098c8c824
I20260812 00:05:31.635094 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:05:31.637315 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.636263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58756 (local address 127.19.59.126:46083)
0812 00:05:31.636323 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:31.636325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:31.636455 (+ 130us) server_negotiation.cc:407] Connection header received
0812 00:05:31.636551 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:31.636553 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:31.636558 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:31.636608 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:31.637109 (+ 501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:31.637110 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:31.637111 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:31.637115 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:31.637127 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:31.637131 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:31.637172 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:31.637239 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 00:05:31.637251 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 00:05:31.639169 25135 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58756:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:31.640697 25135 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:31.644209 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.642626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:44515 (local address 127.0.0.1:59482)
0812 00:05:31.642813 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.642849 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:31.642901 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:31.643227 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:31.643234 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:31.643240 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:31.643745 (+ 505us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:31.643746 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:31.643762 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:31.643785 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:31.644089 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:31.644096 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:31.644099 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:31.644140 (+ 41us) client_negotiation.cc:240] Negotiation successful
0812 00:05:31.644152 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":57,"threads_started":1}
I20260812 00:05:31.644490 25666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.642709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59482 (local address 127.19.59.65:44515)
0812 00:05:31.643055 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:31.643060 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:31.643071 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:05:31.643099 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:31.643102 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:31.643112 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:31.643221 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:31.643875 (+ 654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:31.643897 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:31.643898 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:31.643911 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:31.643948 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:31.643982 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:31.644358 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:31.644383 (+ 25us) server_negotiation.cc:299] Negotiation successful
0812 00:05:31.644398 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":117,"threads_started":1}
I20260812 00:05:31.644907 25664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.642630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:41741 (local address 127.0.0.1:60154)
0812 00:05:31.643249 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.643260 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:31.643297 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:31.644011 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:31.644012 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:31.644015 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:31.644465 (+ 450us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:31.644466 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:31.644472 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:31.644484 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:31.644796 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:31.644797 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:31.644797 (+ 0us) client_negotiation.cc:769] Sending connection context
0812 00:05:31.644848 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:05:31.644863 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"mutex_wait_us":3,"spinlock_wait_cycles":768,"thread_start_us":86,"threads_started":1}
I20260812 00:05:31.645008 25668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.642874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60154 (local address 127.19.59.67:41741)
0812 00:05:31.643164 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:31.643168 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:31.643350 (+ 182us) server_negotiation.cc:407] Connection header received
0812 00:05:31.643376 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:31.643378 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:31.643387 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:31.643740 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:31.644657 (+ 917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:31.644663 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:31.644663 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:31.644668 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:31.644704 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:31.644727 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:31.644783 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:31.644852 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 00:05:31.644867 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":102,"threads_started":1}
I20260812 00:05:31.645156 25273 tablet_service.cc:1467] Processing CreateTablet for tablet 8f5661c50b2b4c14bd4d723f4ec0d69c (DEFAULT_TABLE table=test-table [id=f2f09f98456e4086854dacd9adc038bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:31.645540 25273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f5661c50b2b4c14bd4d723f4ec0d69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:31.645630 25578 tablet_service.cc:1467] Processing CreateTablet for tablet 8f5661c50b2b4c14bd4d723f4ec0d69c (DEFAULT_TABLE table=test-table [id=f2f09f98456e4086854dacd9adc038bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:31.645965 25578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f5661c50b2b4c14bd4d723f4ec0d69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:31.646024 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.642884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58746 (local address 127.19.59.66:43467)
0812 00:05:31.643084 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:31.643088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:31.643150 (+ 62us) server_negotiation.cc:407] Connection header received
0812 00:05:31.643215 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:31.643219 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:31.643231 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:31.643307 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:31.644483 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:31.644488 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:31.644489 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:31.644492 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:31.644539 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:31.644578 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:31.644653 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:31.645912 (+ 1259us) server_negotiation.cc:299] Negotiation successful
0812 00:05:31.645933 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":86,"threads_started":1}
I20260812 00:05:31.646168 25661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.642630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:43467 (local address 127.0.0.1:58746)
0812 00:05:31.643065 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.643075 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:31.643151 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:31.643604 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:31.643605 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:31.643608 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:31.644064 (+ 456us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:31.644064 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:31.644070 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:31.644091 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:31.644678 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:31.644679 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:31.644680 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 00:05:31.646101 (+ 1421us) client_negotiation.cc:240] Negotiation successful
0812 00:05:31.646115 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":94,"threads_started":1}
I20260812 00:05:31.648434 25670 tablet_bootstrap.cc:492] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1: Bootstrap starting.
I20260812 00:05:31.648591 25671 tablet_bootstrap.cc:492] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69: Bootstrap starting.
I20260812 00:05:31.649102 25670 tablet_bootstrap.cc:654] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:31.649161 25671 tablet_bootstrap.cc:654] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:31.649089 25424 tablet_service.cc:1467] Processing CreateTablet for tablet 8f5661c50b2b4c14bd4d723f4ec0d69c (DEFAULT_TABLE table=test-table [id=f2f09f98456e4086854dacd9adc038bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:31.649420 25424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f5661c50b2b4c14bd4d723f4ec0d69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:31.649411 25670 log.cc:824] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:31.649430 25671 log.cc:824] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:31.650163 25671 tablet_bootstrap.cc:492] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69: No bootstrap required, opened a new log
I20260812 00:05:31.650236 25671 ts_tablet_manager.cc:1397] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:31.652649 25674 tablet_bootstrap.cc:492] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2: Bootstrap starting.
I20260812 00:05:31.652897 25671 raft_consensus.cc:348] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8bb640a0414cf992980a251652b5b2" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 43467 } } peers { permanent_uuid: "a05b75767cc04e90ace81ba326331b69" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44515 } } peers { permanent_uuid: "7b3dcef10f064e439fc94fd614c437e1" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 41741 } }
I20260812 00:05:31.653028 25671 raft_consensus.cc:374] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:31.653049 25671 raft_consensus.cc:729] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a05b75767cc04e90ace81ba326331b69, State: Initialized, Role: FOLLOWER
I20260812 00:05:31.653183 25671 consensus_queue.cc:260] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8bb640a0414cf992980a251652b5b2" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 43467 } } peers { permanent_uuid: "a05b75767cc04e90ace81ba326331b69" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44515 } } peers { permanent_uuid: "7b3dcef10f064e439fc94fd614c437e1" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 41741 } }
I20260812 00:05:31.653250 25674 tablet_bootstrap.cc:654] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:31.653455 25671 ts_tablet_manager.cc:1428] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 00:05:31.653501 25350 heartbeater.cc:503] Master 127.19.59.126:46083 was elected leader, sending a full tablet report...
I20260812 00:05:31.653584 25674 log.cc:824] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:31.653972 25670 tablet_bootstrap.cc:492] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1: No bootstrap required, opened a new log
I20260812 00:05:31.654047 25670 ts_tablet_manager.cc:1397] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260812 00:05:31.654588 25674 tablet_bootstrap.cc:492] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2: No bootstrap required, opened a new log
I20260812 00:05:31.654656 25674 ts_tablet_manager.cc:1397] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:31.656044 25670 raft_consensus.cc:348] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8bb640a0414cf992980a251652b5b2" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 43467 } } peers { permanent_uuid: "a05b75767cc04e90ace81ba326331b69" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44515 } } peers { permanent_uuid: "7b3dcef10f064e439fc94fd614c437e1" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 41741 } }
I20260812 00:05:31.656200 25670 raft_consensus.cc:374] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:31.656245 25670 raft_consensus.cc:729] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3dcef10f064e439fc94fd614c437e1, State: Initialized, Role: FOLLOWER
I20260812 00:05:31.656349 25670 consensus_queue.cc:260] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8bb640a0414cf992980a251652b5b2" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 43467 } } peers { permanent_uuid: "a05b75767cc04e90ace81ba326331b69" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44515 } } peers { permanent_uuid: "7b3dcef10f064e439fc94fd614c437e1" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 41741 } }
I20260812 00:05:31.656610 25670 ts_tablet_manager.cc:1428] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:05:31.656668 25652 heartbeater.cc:503] Master 127.19.59.126:46083 was elected leader, sending a full tablet report...
I20260812 00:05:31.656629 25674 raft_consensus.cc:348] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8bb640a0414cf992980a251652b5b2" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 43467 } } peers { permanent_uuid: "a05b75767cc04e90ace81ba326331b69" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44515 } } peers { permanent_uuid: "7b3dcef10f064e439fc94fd614c437e1" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 41741 } }
I20260812 00:05:31.656775 25674 raft_consensus.cc:374] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:31.656814 25674 raft_consensus.cc:729] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd8bb640a0414cf992980a251652b5b2, State: Initialized, Role: FOLLOWER
I20260812 00:05:31.656915 25674 consensus_queue.cc:260] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8bb640a0414cf992980a251652b5b2" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 43467 } } peers { permanent_uuid: "a05b75767cc04e90ace81ba326331b69" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44515 } } peers { permanent_uuid: "7b3dcef10f064e439fc94fd614c437e1" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 41741 } }
I20260812 00:05:31.657157 25674 ts_tablet_manager.cc:1428] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:05:31.657229 25503 heartbeater.cc:503] Master 127.19.59.126:46083 was elected leader, sending a full tablet report...
W20260812 00:05:31.761358 25504 tablet.cc:2369] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:05:31.874559 25653 tablet.cc:2369] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:05:31.902005 25351 tablet.cc:2369] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:05:31.997298 25675 raft_consensus.cc:482] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:31.997414 25675 raft_consensus.cc:504] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8bb640a0414cf992980a251652b5b2" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 43467 } } peers { permanent_uuid: "a05b75767cc04e90ace81ba326331b69" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44515 } } peers { permanent_uuid: "7b3dcef10f064e439fc94fd614c437e1" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 41741 } }
I20260812 00:05:31.997720 25675 leader_election.cc:288] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd8bb640a0414cf992980a251652b5b2 (127.19.59.66:43467), 7b3dcef10f064e439fc94fd614c437e1 (127.19.59.67:41741)
I20260812 00:05:31.999092 25668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.998010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:51425 (local address 127.19.59.67:41741)
0812 00:05:31.998086 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:31.998095 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:31.998157 (+ 62us) server_negotiation.cc:407] Connection header received
0812 00:05:31.998216 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:31.998217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:31.998224 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:31.998279 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:31.998858 (+ 579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:31.998860 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:31.998860 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:31.998864 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:31.998882 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:31.998887 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:31.998964 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:31.999009 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 00:05:31.999023 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 00:05:31.999119 25679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.997923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:41741 (local address 127.19.59.65:51425)
0812 00:05:31.998082 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.998094 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:31.998148 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:31.998292 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:31.998293 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:31.998296 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:31.998755 (+ 459us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:31.998756 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:31.998763 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:31.998773 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:31.998962 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:31.998963 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:31.998963 (+ 0us) client_negotiation.cc:769] Sending connection context
0812 00:05:31.999010 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:05:31.999023 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":84,"threads_started":1}
I20260812 00:05:31.999291 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.998003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:37933 (local address 127.19.59.66:43467)
0812 00:05:31.998086 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:31.998088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:31.998177 (+ 89us) server_negotiation.cc:407] Connection header received
0812 00:05:31.998238 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:31.998239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:31.998243 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:31.998312 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:31.999032 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:31.999033 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:31.999033 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:31.999037 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:31.999060 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:31.999064 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:31.999121 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:31.999206 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 00:05:31.999221 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 00:05:31.999442 25602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f5661c50b2b4c14bd4d723f4ec0d69c" candidate_uuid: "a05b75767cc04e90ace81ba326331b69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3dcef10f064e439fc94fd614c437e1" is_pre_election: true
I20260812 00:05:31.999485 25680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.997924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:43467 (local address 127.19.59.65:37933)
0812 00:05:31.998101 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.998111 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:31.998187 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:31.998352 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:31.998353 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:31.998357 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:31.998918 (+ 561us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:31.998919 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:31.998927 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:31.998941 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:31.999118 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:31.999119 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:31.999120 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 00:05:31.999398 (+ 278us) client_negotiation.cc:240] Negotiation successful
0812 00:05:31.999410 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":2,"thread_start_us":77,"threads_started":1}
I20260812 00:05:31.999604 25602 raft_consensus.cc:2454] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a05b75767cc04e90ace81ba326331b69 in term 0.
I20260812 00:05:31.999804 25451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f5661c50b2b4c14bd4d723f4ec0d69c" candidate_uuid: "a05b75767cc04e90ace81ba326331b69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd8bb640a0414cf992980a251652b5b2" is_pre_election: true
I20260812 00:05:31.999825 25224 leader_election.cc:302] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3dcef10f064e439fc94fd614c437e1, a05b75767cc04e90ace81ba326331b69; no voters:
I20260812 00:05:31.999958 25451 raft_consensus.cc:2454] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a05b75767cc04e90ace81ba326331b69 in term 0.
I20260812 00:05:31.999969 25675 raft_consensus.cc:2781] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:32.000030 25675 raft_consensus.cc:482] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:32.000065 25675 raft_consensus.cc:3037] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:32.000830 25675 raft_consensus.cc:504] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8bb640a0414cf992980a251652b5b2" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 43467 } } peers { permanent_uuid: "a05b75767cc04e90ace81ba326331b69" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44515 } } peers { permanent_uuid: "7b3dcef10f064e439fc94fd614c437e1" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 41741 } }
I20260812 00:05:32.000979 25675 leader_election.cc:288] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [CANDIDATE]: Term 1 election: Requested vote from peers fd8bb640a0414cf992980a251652b5b2 (127.19.59.66:43467), 7b3dcef10f064e439fc94fd614c437e1 (127.19.59.67:41741)
I20260812 00:05:32.001111 25451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f5661c50b2b4c14bd4d723f4ec0d69c" candidate_uuid: "a05b75767cc04e90ace81ba326331b69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd8bb640a0414cf992980a251652b5b2"
I20260812 00:05:32.001163 25602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f5661c50b2b4c14bd4d723f4ec0d69c" candidate_uuid: "a05b75767cc04e90ace81ba326331b69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3dcef10f064e439fc94fd614c437e1"
I20260812 00:05:32.001187 25451 raft_consensus.cc:3037] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:32.001248 25602 raft_consensus.cc:3037] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:32.001995 25451 raft_consensus.cc:2454] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a05b75767cc04e90ace81ba326331b69 in term 1.
I20260812 00:05:32.002102 25602 raft_consensus.cc:2454] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a05b75767cc04e90ace81ba326331b69 in term 1.
I20260812 00:05:32.002153 25223 leader_election.cc:302] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a05b75767cc04e90ace81ba326331b69, fd8bb640a0414cf992980a251652b5b2; no voters:
I20260812 00:05:32.002238 25675 raft_consensus.cc:2781] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:32.002365 25675 raft_consensus.cc:686] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [term 1 LEADER]: Becoming Leader. State: Replica: a05b75767cc04e90ace81ba326331b69, State: Running, Role: LEADER
I20260812 00:05:32.002480 25675 consensus_queue.cc:237] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8bb640a0414cf992980a251652b5b2" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 43467 } } peers { permanent_uuid: "a05b75767cc04e90ace81ba326331b69" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44515 } } peers { permanent_uuid: "7b3dcef10f064e439fc94fd614c437e1" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 41741 } }
I20260812 00:05:32.003369 25134 catalog_manager.cc:5495] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 reported cstate change: term changed from 0 to 1, leader changed from <none> to a05b75767cc04e90ace81ba326331b69 (127.19.59.65). New cstate: current_term: 1 leader_uuid: "a05b75767cc04e90ace81ba326331b69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8bb640a0414cf992980a251652b5b2" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 43467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a05b75767cc04e90ace81ba326331b69" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b3dcef10f064e439fc94fd614c437e1" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 41741 } health_report { overall_health: UNKNOWN } } }
I20260812 00:05:32.084775 25666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:32.083766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59488 (local address 127.19.59.65:44515)
0812 00:05:32.083837 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:32.083838 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:32.083847 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:32.083888 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:32.083889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:32.083905 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:32.083959 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:32.084609 (+ 650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:32.084610 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:32.084610 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:32.084613 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:32.084627 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:32.084631 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:32.084673 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:32.084708 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 00:05:32.084720 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 00:05:32.086606 25451 raft_consensus.cc:1261] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2 [term 1 FOLLOWER]: Refusing update from remote peer a05b75767cc04e90ace81ba326331b69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:32.086652 25602 raft_consensus.cc:1261] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1 [term 1 FOLLOWER]: Refusing update from remote peer a05b75767cc04e90ace81ba326331b69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:32.086998 25675 consensus_queue.cc:1035] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd8bb640a0414cf992980a251652b5b2" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 43467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:32.087188 25681 consensus_queue.cc:1035] T 8f5661c50b2b4c14bd4d723f4ec0d69c P a05b75767cc04e90ace81ba326331b69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3dcef10f064e439fc94fd614c437e1" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 41741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:32.089548 25686 mvcc.cc:205] Tried to move back new op lower bound from 7317475869023883264 to 7317475868682653696. Current Snapshot: MvccSnapshot[applied={T|T < 7317475869023883264}]
I20260812 00:05:32.089555 25687 mvcc.cc:205] Tried to move back new op lower bound from 7317475869023883264 to 7317475868682653696. Current Snapshot: MvccSnapshot[applied={T|T < 7317475869023883264}]
I20260812 00:05:32.089694 25684 mvcc.cc:205] Tried to move back new op lower bound from 7317475869023883264 to 7317475868682653696. Current Snapshot: MvccSnapshot[applied={T|T < 7317475869023883264 or (T in {7317475869023883264})}]
I20260812 00:05:32.091837 25134 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:32.091931 25134 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:32.092706 25134 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e304fe6e1eb4611914368ea358f1613: Sending DeleteTablet for 3 replicas of tablet 8f5661c50b2b4c14bd4d723f4ec0d69c
I20260812 00:05:32.093047 25578 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f5661c50b2b4c14bd4d723f4ec0d69c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:32 UTC) from {username='slave'} at 127.0.0.1:60154
I20260812 00:05:32.093190 25424 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f5661c50b2b4c14bd4d723f4ec0d69c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:32 UTC) from {username='slave'} at 127.0.0.1:58746
I20260812 00:05:32.093282 25273 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f5661c50b2b4c14bd4d723f4ec0d69c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:32 UTC) from {username='slave'} at 127.0.0.1:59482
I20260812 00:05:32.093430 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 25207
I20260812 00:05:32.097978 25697 tablet_replica.cc:330] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1: stopping tablet replica
I20260812 00:05:32.098094 25697 raft_consensus.cc:2229] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:32.098199 25697 raft_consensus.cc:2258] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:32.098357 25698 tablet_replica.cc:330] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2: stopping tablet replica
I20260812 00:05:32.098445 25698 raft_consensus.cc:2229] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:32.098551 25698 raft_consensus.cc:2258] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:32.098697 25697 ts_tablet_manager.cc:1905] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:32.099030 25698 ts_tablet_manager.cc:1905] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:32.100521 25697 ts_tablet_manager.cc:1918] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:32.100602 25697 log.cc:1196] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/8f5661c50b2b4c14bd4d723f4ec0d69c
I20260812 00:05:32.100708 25698 ts_tablet_manager.cc:1918] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:32.100775 25698 log.cc:1196] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/8f5661c50b2b4c14bd4d723f4ec0d69c
I20260812 00:05:32.100893 25697 ts_tablet_manager.cc:1939] T 8f5661c50b2b4c14bd4d723f4ec0d69c P 7b3dcef10f064e439fc94fd614c437e1: Deleting consensus metadata
I20260812 00:05:32.101028 25698 ts_tablet_manager.cc:1939] T 8f5661c50b2b4c14bd4d723f4ec0d69c P fd8bb640a0414cf992980a251652b5b2: Deleting consensus metadata
I20260812 00:05:32.101266 25118 catalog_manager.cc:4841] TS 7b3dcef10f064e439fc94fd614c437e1 (127.19.59.67:41741): tablet 8f5661c50b2b4c14bd4d723f4ec0d69c (table test-table [id=f2f09f98456e4086854dacd9adc038bb]) successfully deleted
I20260812 00:05:32.101383 25117 catalog_manager.cc:4841] TS fd8bb640a0414cf992980a251652b5b2 (127.19.59.66:43467): tablet 8f5661c50b2b4c14bd4d723f4ec0d69c (table test-table [id=f2f09f98456e4086854dacd9adc038bb]) successfully deleted
W20260812 00:05:32.101703 25119 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:44515 (error 108)
I20260812 00:05:32.101972 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 25353
I20260812 00:05:32.102135 25661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:32.102011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:44515 (local address 127.0.0.1:59504)
0812 00:05:32.102064 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:32.102101 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:44515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 00:05:32.102231 25119 catalog_manager.cc:4584] TS a05b75767cc04e90ace81ba326331b69 (127.19.59.65:44515): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8f5661c50b2b4c14bd4d723f4ec0d69c: Network error: Client connection negotiation failed: client connection to 127.19.59.65:44515: connect: Connection refused (error 111)
I20260812 00:05:32.107623 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 25506
I20260812 00:05:32.113564 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 25100
2026-08-12T00:05:32Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (975 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 00:05:32.134068 19693 mini_oidc.cc:152] Starting JWKS server
I20260812 00:05:32.135077 19693 webserver.cc:460] Webserver started at https://127.0.0.1:41295/ using document root <none> and password file <none>
I20260812 00:05:32.135147 19693 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 00:05:32.135268 19693 webserver.cc:460] Webserver started at http://127.0.0.1:38553/ using document root <none> and password file <none>
2026-08-12T00:05:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:32Z Disabled control of system clock
I20260812 00:05:32.143024 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:32877
--webserver_interface=127.19.59.126
--webserver_port=0
--builtin_ntp_servers=127.19.59.84:45823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:32877
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41295/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/testchainca.cert with env {}
W20260812 00:05:32.220286 25709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:32.220504 25709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:32.220527 25709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:32.221729 25709 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:32.221771 25709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:32.221783 25709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:32.221796 25709 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:32.221822 25709 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:05:32.221863 25709 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:05:32.221889 25709 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41295/jwks.json
I20260812 00:05:32.223428 25709 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:45823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:32877
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:32877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41295/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25709
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:32.223603 25709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:32.223752 25709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:32.228410 25716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:32.228446 25709 server_base.cc:1034] running on GCE node
W20260812 00:05:32.228410 25719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:32.228464 25717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:32.228964 25709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:32.229244 25709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:32.230414 25709 hybrid_clock.cc:648] HybridClock initialized: now 1786493132230395 us; error 35 us; skew 500 ppm
I20260812 00:05:32.231562 25709 webserver.cc:460] Webserver started at http://127.19.59.126:46413/ using document root <none> and password file <none>
I20260812 00:05:32.231841 25709 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:32.231890 25709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:32.232079 25709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:32.233078 25709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "9ec6db318a5e4388882d6f89f842f6b0"
format_stamp: "Formatted at 2026-08-12 00:05:32 on dist-test-slave-6nmv"
server_key: "d611ea85e859380ee02bfd76b644a596"
server_key_iv: "8f5201790024fe2193b659915fb22020"
server_key_version: "encryptionkey@0"
I20260812 00:05:32.233438 25709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "9ec6db318a5e4388882d6f89f842f6b0"
format_stamp: "Formatted at 2026-08-12 00:05:32 on dist-test-slave-6nmv"
server_key: "d611ea85e859380ee02bfd76b644a596"
server_key_iv: "8f5201790024fe2193b659915fb22020"
server_key_version: "encryptionkey@0"
I20260812 00:05:32.234848 25709 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:05:32.235555 25725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:32.235728 25709 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:32.235836 25709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "9ec6db318a5e4388882d6f89f842f6b0"
format_stamp: "Formatted at 2026-08-12 00:05:32 on dist-test-slave-6nmv"
server_key: "d611ea85e859380ee02bfd76b644a596"
server_key_iv: "8f5201790024fe2193b659915fb22020"
server_key_version: "encryptionkey@0"
I20260812 00:05:32.235908 25709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:32.252792 25709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:32.253069 25709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:32.253221 25709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:32.257484 25709 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:32877
I20260812 00:05:32.257517 25781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:32877 every 8 connection(s)
I20260812 00:05:32.257860 25709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:32.258716 25782 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:32.260757 25782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0: Bootstrap starting.
I20260812 00:05:32.261345 25782 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:32.261641 25782 log.cc:824] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:32.262282 25782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0: No bootstrap required, opened a new log
I20260812 00:05:32.263924 25782 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec6db318a5e4388882d6f89f842f6b0" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 32877 } }
I20260812 00:05:32.264060 25782 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:32.264107 25782 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ec6db318a5e4388882d6f89f842f6b0, State: Initialized, Role: FOLLOWER
I20260812 00:05:32.264246 25782 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec6db318a5e4388882d6f89f842f6b0" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 32877 } }
I20260812 00:05:32.264314 25782 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:32.264354 25782 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:32.264398 25782 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:32.264865 25782 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec6db318a5e4388882d6f89f842f6b0" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 32877 } }
I20260812 00:05:32.264988 25782 leader_election.cc:302] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ec6db318a5e4388882d6f89f842f6b0; no voters:
I20260812 00:05:32.265162 25782 leader_election.cc:288] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:32.265197 25785 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:32.265347 25785 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [term 1 LEADER]: Becoming Leader. State: Replica: 9ec6db318a5e4388882d6f89f842f6b0, State: Running, Role: LEADER
I20260812 00:05:32.265408 25782 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:32.265460 25785 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec6db318a5e4388882d6f89f842f6b0" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 32877 } }
I20260812 00:05:32.265910 25786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ec6db318a5e4388882d6f89f842f6b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec6db318a5e4388882d6f89f842f6b0" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 32877 } } }
I20260812 00:05:32.266001 25786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:32.266116 25787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ec6db318a5e4388882d6f89f842f6b0. Latest consensus state: current_term: 1 leader_uuid: "9ec6db318a5e4388882d6f89f842f6b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec6db318a5e4388882d6f89f842f6b0" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 32877 } } }
I20260812 00:05:32.266271 25787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:32.266443 25794 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:32.266909 25794 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:32.267068 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 25709
I20260812 00:05:32.267182 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:32.267380 19693 external_mini_cluster.cc:1428] Setting key fc3bc0afc2731224ca01d75c9c6e8fbc
I20260812 00:05:32.268323 25794 catalog_manager.cc:1347] Generated new cluster ID: e10273be6f434ea0b32bb609243d62ef
I20260812 00:05:32.268378 25794 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:32.273300 25805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:32.267775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48664 (local address 127.19.59.126:32877)
0812 00:05:32.267938 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:32.267952 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:32.268102 (+ 150us) server_negotiation.cc:407] Connection header received
0812 00:05:32.268233 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:32.268238 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:32.268313 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:32.268435 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:32.268745 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.270057 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.271061 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.271699 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.271820 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:32.272477 (+ 657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:32.272481 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:32.272482 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:32.272679 (+ 197us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:32.272719 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:32.272734 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:32.272813 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:32.272884 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:05:32.272961 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":100,"thread_start_us":62,"threads_started":1}
I20260812 00:05:32.274299 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:05:32.277648 25794 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:32.278134 25794 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:32.283341 25794 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ec6db318a5e4388882d6f89f842f6b0: Generated new TSK 0
I20260812 00:05:32.283505 25794 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 00:05:32.310256 25815 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 00:05:32.310325 25815 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 00:05:32.310427 25805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:32.289283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48668 (local address 127.19.59.126:32877)
0812 00:05:32.289323 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:32.289325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:32.289492 (+ 167us) server_negotiation.cc:407] Connection header received
0812 00:05:32.289573 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:32.289574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:32.289582 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:32.289632 (+ 50us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:05:32.289788 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.290249 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.291248 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.291404 (+ 156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.291444 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:32.291663 (+ 219us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:05:32.310225 (+ 18562us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41295/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 00:05:32.310362 (+ 137us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48668: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41295/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 00:05:32.310469 25805 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48668: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41295/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 00:05:32.310803 25814 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:32.289230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:32877 (local address 127.0.0.1:48668)
0812 00:05:32.289408 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:32.289428 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:32.289492 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:32.289658 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:32.289659 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:32.289665 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:05:32.289729 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:32.289731 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.290324 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.290325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:32.291167 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:32.291169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.291468 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.291469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:32.291539 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:32.291559 (+ 20us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:05:32.310335 (+ 18776us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41295/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 00:05:32.310430 (+ 95us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.59.126:32877: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41295/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":64,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.19.59.126:32877: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41295/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 00:05:32.311309 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 25709
2026-08-12T00:05:32Z chronyd exiting
I20260812 00:05:32.349676 19693 test_util.cc:175] -----------------------------------------------
I20260812 00:05:32.349738 19693 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786493109864389-19693-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (216 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 00:05:32.350420 19693 mini_oidc.cc:152] Starting JWKS server
I20260812 00:05:32.351117 19693 webserver.cc:460] Webserver started at https://127.0.0.1:39479/ using document root <none> and password file <none>
I20260812 00:05:32.351157 19693 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 00:05:32.351327 19693 webserver.cc:460] Webserver started at http://127.0.0.1:44959/ using document root <none> and password file <none>
2026-08-12T00:05:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:32Z Disabled control of system clock
I20260812 00:05:32.359566 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:38897
--webserver_interface=127.19.59.126
--webserver_port=0
--builtin_ntp_servers=127.19.59.84:41973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:38897
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39479/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/testchainca.cert with env {}
W20260812 00:05:32.437454 25822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:32.437645 25822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:32.437666 25822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:32.438745 25822 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:32.438783 25822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:32.438795 25822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:32.438807 25822 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:32.438858 25822 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:05:32.438874 25822 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:05:32.438894 25822 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39479/jwks.json
I20260812 00:05:32.440231 25822 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:41973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:38897
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:38897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39479/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:32.440460 25822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:32.440651 25822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:32.445005 25830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:32.445118 25827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:32.445214 25822 server_base.cc:1034] running on GCE node
W20260812 00:05:32.445190 25828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:32.445636 25822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:32.445971 25822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:32.447115 25822 hybrid_clock.cc:648] HybridClock initialized: now 1786493132447096 us; error 37 us; skew 500 ppm
I20260812 00:05:32.448258 25822 webserver.cc:460] Webserver started at http://127.19.59.126:43831/ using document root <none> and password file <none>
I20260812 00:05:32.448483 25822 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:32.448527 25822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:32.448679 25822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:32.449630 25822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "ba7980e2efb446678240c048d83b0f39"
format_stamp: "Formatted at 2026-08-12 00:05:32 on dist-test-slave-6nmv"
server_key: "5cad6fc40616ed24013d03693704b644"
server_key_iv: "6000f43c8f59dd1f1c5f97d31c60b713"
server_key_version: "encryptionkey@0"
I20260812 00:05:32.449991 25822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "ba7980e2efb446678240c048d83b0f39"
format_stamp: "Formatted at 2026-08-12 00:05:32 on dist-test-slave-6nmv"
server_key: "5cad6fc40616ed24013d03693704b644"
server_key_iv: "6000f43c8f59dd1f1c5f97d31c60b713"
server_key_version: "encryptionkey@0"
I20260812 00:05:32.451247 25822 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:32.451995 25838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:32.452159 25822 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:32.452250 25822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "ba7980e2efb446678240c048d83b0f39"
format_stamp: "Formatted at 2026-08-12 00:05:32 on dist-test-slave-6nmv"
server_key: "5cad6fc40616ed24013d03693704b644"
server_key_iv: "6000f43c8f59dd1f1c5f97d31c60b713"
server_key_version: "encryptionkey@0"
I20260812 00:05:32.452334 25822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:32.460419 25822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:32.460671 25822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:32.460799 25822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:32.464591 25822 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:38897
I20260812 00:05:32.464619 25895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:38897 every 8 connection(s)
I20260812 00:05:32.464905 25822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:32.465485 25896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:32.467959 25896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39: Bootstrap starting.
I20260812 00:05:32.468513 25896 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:32.468818 25896 log.cc:824] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:32.469480 25896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39: No bootstrap required, opened a new log
I20260812 00:05:32.471094 25896 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba7980e2efb446678240c048d83b0f39" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 38897 } }
I20260812 00:05:32.471249 25896 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:32.471295 25896 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7980e2efb446678240c048d83b0f39, State: Initialized, Role: FOLLOWER
I20260812 00:05:32.471444 25896 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba7980e2efb446678240c048d83b0f39" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 38897 } }
I20260812 00:05:32.471503 25896 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:32.471541 25896 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:32.471589 25896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:32.472220 25896 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba7980e2efb446678240c048d83b0f39" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 38897 } }
I20260812 00:05:32.472337 25896 leader_election.cc:302] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba7980e2efb446678240c048d83b0f39; no voters:
I20260812 00:05:32.472523 25896 leader_election.cc:288] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:32.472545 25900 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:32.472692 25900 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [term 1 LEADER]: Becoming Leader. State: Replica: ba7980e2efb446678240c048d83b0f39, State: Running, Role: LEADER
I20260812 00:05:32.472805 25896 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:32.472788 25900 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba7980e2efb446678240c048d83b0f39" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 38897 } }
I20260812 00:05:32.473191 25901 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba7980e2efb446678240c048d83b0f39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba7980e2efb446678240c048d83b0f39" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 38897 } } }
I20260812 00:05:32.473290 25901 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:32.473400 25902 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba7980e2efb446678240c048d83b0f39. Latest consensus state: current_term: 1 leader_uuid: "ba7980e2efb446678240c048d83b0f39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba7980e2efb446678240c048d83b0f39" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 38897 } } }
I20260812 00:05:32.473487 25902 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:32.473589 25907 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:32.473703 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 25822
I20260812 00:05:32.473836 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:32.474097 19693 external_mini_cluster.cc:1428] Setting key 768745ee2c3cc70e2b1729431d2e9c6e
I20260812 00:05:32.474128 25907 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:32.475854 25907 catalog_manager.cc:1347] Generated new cluster ID: 6dc84790225840338d643c6ca3d88b60
I20260812 00:05:32.475907 25907 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:32.479889 25921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:32.474619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51418 (local address 127.19.59.126:38897)
0812 00:05:32.474820 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:32.474828 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:32.474857 (+ 29us) server_negotiation.cc:407] Connection header received
0812 00:05:32.474949 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:32.474954 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:32.475049 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:32.475179 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:32.475542 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.476797 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.477919 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.478492 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.478591 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:32.479227 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:32.479231 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:32.479231 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:32.479422 (+ 191us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:32.479472 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:32.479484 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:32.479543 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:32.479627 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 00:05:32.479691 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":75,"threads_started":1}
I20260812 00:05:32.480669 25907 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:32.480818 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:05:32.481223 25907 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:32.488163 25907 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba7980e2efb446678240c048d83b0f39: Generated new TSK 0
I20260812 00:05:32.488322 25907 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 00:05:32.509508 25930 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 00:05:32.509586 25930 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 00:05:32.509887 25921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:32.495802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51428 (local address 127.19.59.126:38897)
0812 00:05:32.495881 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:32.495883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:32.495969 (+ 86us) server_negotiation.cc:407] Connection header received
0812 00:05:32.496016 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:32.496017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:32.496039 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:32.496115 (+ 76us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:05:32.496203 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.496917 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.497653 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.497963 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.498049 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:32.498206 (+ 157us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:05:32.509668 (+ 11462us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39479/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 00:05:32.509804 (+ 136us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51428: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39479/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":61}
W20260812 00:05:32.509943 25921 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51428: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39479/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 00:05:32.509981 25928 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:32.495726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:38897 (local address 127.0.0.1:51428)
0812 00:05:32.495876 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:32.495900 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:32.495961 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:32.496111 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:32.496112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:32.496113 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:05:32.496153 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:32.496154 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.497013 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.497014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:32.497566 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:32.497568 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.498051 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.498052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:32.498098 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:32.498102 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:05:32.509771 (+ 11669us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39479/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 00:05:32.509892 (+ 121us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.59.126:38897: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39479/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":94,"threads_started":1}
I20260812 00:05:32.510186 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 25822
2026-08-12T00:05:32Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (200 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 00:05:32.550881 19693 mini_oidc.cc:152] Starting JWKS server
I20260812 00:05:32.551537 19693 webserver.cc:460] Webserver started at https://127.0.0.1:43107/ using document root <none> and password file <none>
I20260812 00:05:32.551579 19693 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 00:05:32.551777 19693 webserver.cc:460] Webserver started at http://127.0.0.1:43407/ using document root <none> and password file <none>
2026-08-12T00:05:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:32Z Disabled control of system clock
I20260812 00:05:32.560451 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:35371
--webserver_interface=127.19.59.126
--webserver_port=0
--builtin_ntp_servers=127.19.59.84:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:35371
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43107/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 00:05:32.639664 25937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:32.639897 25937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:32.639936 25937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:32.641084 25937 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:32.641155 25937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:32.641181 25937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:32.641214 25937 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:32.641239 25937 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:05:32.641270 25937 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:05:32.641295 25937 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43107/jwks.json
I20260812 00:05:32.642656 25937 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:35371
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:35371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43107/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25937
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:32.642954 25937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:32.643245 25937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:32.648125 25943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:32.648176 25937 server_base.cc:1034] running on GCE node
W20260812 00:05:32.648164 25942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:32.648118 25945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:32.648569 25937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:32.648847 25937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:32.650067 25937 hybrid_clock.cc:648] HybridClock initialized: now 1786493132650054 us; error 45 us; skew 500 ppm
I20260812 00:05:32.651247 25937 webserver.cc:460] Webserver started at http://127.19.59.126:42993/ using document root <none> and password file <none>
I20260812 00:05:32.651517 25937 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:32.651585 25937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:32.651769 25937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:32.652772 25937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "c52fa530b5e74b4599cb70e6d4339599"
format_stamp: "Formatted at 2026-08-12 00:05:32 on dist-test-slave-6nmv"
server_key: "730d809ed48f0d6ac62ab1c1df1367d8"
server_key_iv: "beea4a50e99fdf875e9cd2f65a31813a"
server_key_version: "encryptionkey@0"
I20260812 00:05:32.653143 25937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "c52fa530b5e74b4599cb70e6d4339599"
format_stamp: "Formatted at 2026-08-12 00:05:32 on dist-test-slave-6nmv"
server_key: "730d809ed48f0d6ac62ab1c1df1367d8"
server_key_iv: "beea4a50e99fdf875e9cd2f65a31813a"
server_key_version: "encryptionkey@0"
I20260812 00:05:32.654444 25937 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:32.655090 25954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:32.655247 25937 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:32.655337 25937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "c52fa530b5e74b4599cb70e6d4339599"
format_stamp: "Formatted at 2026-08-12 00:05:32 on dist-test-slave-6nmv"
server_key: "730d809ed48f0d6ac62ab1c1df1367d8"
server_key_iv: "beea4a50e99fdf875e9cd2f65a31813a"
server_key_version: "encryptionkey@0"
I20260812 00:05:32.655411 25937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:32.667439 25937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:32.667699 25937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:32.667840 25937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:32.671729 25937 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:35371
I20260812 00:05:32.671765 26019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:35371 every 8 connection(s)
I20260812 00:05:32.672091 25937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:32.672818 26020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:32.674224 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 25937
I20260812 00:05:32.674321 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:32.674511 19693 external_mini_cluster.cc:1428] Setting key 5927aab4fea52740ec009bebf5394df2
I20260812 00:05:32.676497 26020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599: Bootstrap starting.
I20260812 00:05:32.677170 26020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:32.677495 26020 log.cc:824] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:32.678267 26020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599: No bootstrap required, opened a new log
I20260812 00:05:32.679862 26023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:32.675024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36192 (local address 127.19.59.126:35371)
0812 00:05:32.675226 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:32.675232 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:32.675256 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:05:32.675639 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:32.675645 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:32.675698 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:32.675801 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:32.676054 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.676935 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.678040 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.678459 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.678550 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:32.679234 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:32.679238 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:32.679238 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:32.679387 (+ 149us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:32.679418 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:32.679426 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:32.679478 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:32.679586 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 00:05:32.679638 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
I20260812 00:05:32.680537 26020 raft_consensus.cc:348] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c52fa530b5e74b4599cb70e6d4339599" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35371 } }
I20260812 00:05:32.680699 26020 raft_consensus.cc:374] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:32.680747 26020 raft_consensus.cc:729] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c52fa530b5e74b4599cb70e6d4339599, State: Initialized, Role: FOLLOWER
I20260812 00:05:32.680773 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:05:32.680918 26020 consensus_queue.cc:260] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c52fa530b5e74b4599cb70e6d4339599" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35371 } }
I20260812 00:05:32.681000 26020 raft_consensus.cc:388] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:32.681030 26020 raft_consensus.cc:482] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:32.681075 26020 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:32.681715 26020 raft_consensus.cc:504] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c52fa530b5e74b4599cb70e6d4339599" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35371 } }
I20260812 00:05:32.681871 26020 leader_election.cc:302] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c52fa530b5e74b4599cb70e6d4339599; no voters:
I20260812 00:05:32.682049 26020 leader_election.cc:288] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:32.682101 26025 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:32.682252 26025 raft_consensus.cc:686] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [term 1 LEADER]: Becoming Leader. State: Replica: c52fa530b5e74b4599cb70e6d4339599, State: Running, Role: LEADER
I20260812 00:05:32.682325 26025 consensus_queue.cc:237] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c52fa530b5e74b4599cb70e6d4339599" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35371 } }
I20260812 00:05:32.682348 26020 sys_catalog.cc:564] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:32.682662 26027 sys_catalog.cc:455] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c52fa530b5e74b4599cb70e6d4339599. Latest consensus state: current_term: 1 leader_uuid: "c52fa530b5e74b4599cb70e6d4339599" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c52fa530b5e74b4599cb70e6d4339599" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35371 } } }
I20260812 00:05:32.682761 26027 sys_catalog.cc:458] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:32.682659 26026 sys_catalog.cc:455] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c52fa530b5e74b4599cb70e6d4339599" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c52fa530b5e74b4599cb70e6d4339599" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35371 } } }
I20260812 00:05:32.682948 26026 sys_catalog.cc:458] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:32.683228 26032 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:32.683708 26032 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:32.685125 26032 catalog_manager.cc:1347] Generated new cluster ID: dd5f77a4e004435d9670198b5a316f6a
I20260812 00:05:32.685176 26032 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:32.697113 26032 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:32.697706 26032 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:32.702636 26032 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c52fa530b5e74b4599cb70e6d4339599: Generated new TSK 0
I20260812 00:05:32.702788 26032 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:05:32.718067 26023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:32.714548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36198 (local address 127.19.59.126:35371)
0812 00:05:32.714604 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:32.714606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:32.714693 (+ 87us) server_negotiation.cc:407] Connection header received
0812 00:05:32.714732 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:32.714733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:32.714744 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:32.714834 (+ 90us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:05:32.714960 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.715725 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.716382 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.716690 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.716760 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:32.716897 (+ 137us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:05:32.717865 (+ 968us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43107/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 00:05:32.717998 (+ 133us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36198: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43107/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":34}
W20260812 00:05:32.718123 26023 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36198: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43107/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 00:05:32.718153 26054 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:32.714464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:35371 (local address 127.0.0.1:36198)
0812 00:05:32.714621 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:32.714631 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:32.714690 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:32.714837 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:32.714838 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:32.714839 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:05:32.714894 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:32.714896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.715791 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.715792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:32.716309 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:32.716310 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.716767 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.716768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:32.716808 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:32.716812 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:05:32.717965 (+ 1153us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43107/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 00:05:32.718059 (+ 94us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.59.126:35371: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43107/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":104,"threads_started":1}
I20260812 00:05:32.720185 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 25937
E20260812 00:05:32.734015 26055 webserver.cc:533] Webserver: sslize failed:
E20260812 00:05:32.734086 26055 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-12T00:05:32Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (211 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T00:05:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:32Z Disabled control of system clock
I20260812 00:05:32.770648 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:39255
--webserver_interface=127.19.59.126
--webserver_port=0
--builtin_ntp_servers=127.19.59.84:44645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:39255
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/testchainca.cert with env {}
W20260812 00:05:32.848472 26059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:32.848660 26059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:32.848681 26059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:32.849825 26059 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:32.849892 26059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:32.849905 26059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:32.849952 26059 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:32.849968 26059 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:05:32.849992 26059 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:05:32.850018 26059 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 00:05:32.851437 26059 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:39255
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:39255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:32.851693 26059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:32.851917 26059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:32.856635 26065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:32.856660 26069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:32.856667 26064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:32.856685 26059 server_base.cc:1034] running on GCE node
I20260812 00:05:32.857005 26059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:32.857286 26059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:32.858423 26059 hybrid_clock.cc:648] HybridClock initialized: now 1786493132858401 us; error 35 us; skew 500 ppm
I20260812 00:05:32.859586 26059 webserver.cc:460] Webserver started at http://127.19.59.126:35767/ using document root <none> and password file <none>
I20260812 00:05:32.859808 26059 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:32.859874 26059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:32.860013 26059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:32.860997 26059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "278d4912256e4291a6019bbcfe18206d"
format_stamp: "Formatted at 2026-08-12 00:05:32 on dist-test-slave-6nmv"
server_key: "ea8fac61965cedfa56dc099f0d67a248"
server_key_iv: "e41f9718d1b9cfdfbbcbcb1993f3b801"
server_key_version: "encryptionkey@0"
I20260812 00:05:32.861332 26059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "278d4912256e4291a6019bbcfe18206d"
format_stamp: "Formatted at 2026-08-12 00:05:32 on dist-test-slave-6nmv"
server_key: "ea8fac61965cedfa56dc099f0d67a248"
server_key_iv: "e41f9718d1b9cfdfbbcbcb1993f3b801"
server_key_version: "encryptionkey@0"
I20260812 00:05:32.862612 26059 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:32.863390 26075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:32.863580 26059 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:32.863682 26059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "278d4912256e4291a6019bbcfe18206d"
format_stamp: "Formatted at 2026-08-12 00:05:32 on dist-test-slave-6nmv"
server_key: "ea8fac61965cedfa56dc099f0d67a248"
server_key_iv: "e41f9718d1b9cfdfbbcbcb1993f3b801"
server_key_version: "encryptionkey@0"
I20260812 00:05:32.863752 26059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:32.896464 26059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:32.896760 26059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:32.896900 26059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:32.900835 26059 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:39255
I20260812 00:05:32.900892 26143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:39255 every 8 connection(s)
I20260812 00:05:32.901230 26059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:32.902241 26144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:32.904553 26144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d: Bootstrap starting.
I20260812 00:05:32.905107 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 26059
I20260812 00:05:32.905159 26144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:32.905217 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:32.905382 19693 external_mini_cluster.cc:1428] Setting key c0a5864bbc76c7d07cf623b5274d8862
I20260812 00:05:32.905464 26144 log.cc:824] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:32.906356 26144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d: No bootstrap required, opened a new log
I20260812 00:05:32.908649 26144 raft_consensus.cc:348] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278d4912256e4291a6019bbcfe18206d" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 39255 } }
I20260812 00:05:32.908766 26144 raft_consensus.cc:374] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:32.908787 26144 raft_consensus.cc:729] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 278d4912256e4291a6019bbcfe18206d, State: Initialized, Role: FOLLOWER
I20260812 00:05:32.908936 26144 consensus_queue.cc:260] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278d4912256e4291a6019bbcfe18206d" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 39255 } }
I20260812 00:05:32.909018 26144 raft_consensus.cc:388] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:32.909060 26144 raft_consensus.cc:482] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:32.909108 26144 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:32.909757 26144 raft_consensus.cc:504] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278d4912256e4291a6019bbcfe18206d" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 39255 } }
I20260812 00:05:32.909895 26144 leader_election.cc:302] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 278d4912256e4291a6019bbcfe18206d; no voters:
I20260812 00:05:32.910050 26144 leader_election.cc:288] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:32.910118 26150 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:32.910271 26144 sys_catalog.cc:564] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:32.910275 26150 raft_consensus.cc:686] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [term 1 LEADER]: Becoming Leader. State: Replica: 278d4912256e4291a6019bbcfe18206d, State: Running, Role: LEADER
I20260812 00:05:32.910725 26150 consensus_queue.cc:237] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278d4912256e4291a6019bbcfe18206d" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 39255 } }
I20260812 00:05:32.911047 26150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 278d4912256e4291a6019bbcfe18206d. Latest consensus state: current_term: 1 leader_uuid: "278d4912256e4291a6019bbcfe18206d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278d4912256e4291a6019bbcfe18206d" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 39255 } } }
I20260812 00:05:32.911119 26150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:32.911412 26152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "278d4912256e4291a6019bbcfe18206d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278d4912256e4291a6019bbcfe18206d" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 39255 } } }
I20260812 00:05:32.911478 26152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:32.911818 26149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:32.905924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36192 (local address 127.19.59.126:39255)
0812 00:05:32.906119 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:32.906127 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:32.906158 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:05:32.906726 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:32.906734 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:32.906801 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:32.906936 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:32.907105 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.908420 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.909320 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.909987 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.910104 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:32.910795 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:32.910799 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:32.910799 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:32.910984 (+ 185us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:32.911026 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:32.911042 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:32.911106 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:32.911368 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 00:05:32.911461 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":92,"threads_started":1}
I20260812 00:05:32.911823 26159 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:32.912361 26159 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:32.912820 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:05:32.913792 26159 catalog_manager.cc:1347] Generated new cluster ID: a7a883c1fd1c42038acb38ac134a58cb
I20260812 00:05:32.913868 26159 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:32.952392 26159 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:32.952910 26159 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:32.957969 26159 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 278d4912256e4291a6019bbcfe18206d: Generated new TSK 0
I20260812 00:05:32.958132 26159 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:05:33.046422 26149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:32.966687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36208 (local address 127.19.59.126:39255)
0812 00:05:32.966724 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:32.966726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:32.966815 (+ 89us) server_negotiation.cc:407] Connection header received
0812 00:05:32.966887 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:32.966888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:32.966895 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:32.966947 (+ 52us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:05:32.967050 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.967475 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.968505 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.968672 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.968718 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:32.968886 (+ 168us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:05:33.046123 (+ 77237us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 00:05:33.046340 (+ 217us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36208: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 00:05:33.046507 26149 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36208: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 00:05:33.046727 26178 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:32.966624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:39255 (local address 127.0.0.1:36208)
0812 00:05:32.966767 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:32.966776 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:32.966829 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:32.966947 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:32.966948 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:32.966950 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:05:32.967000 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:32.967002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.967577 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.967578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:32.968426 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:32.968428 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:32.968743 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:32.968744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:32.968802 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:32.968807 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:05:33.046327 (+ 77520us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 00:05:33.046618 (+ 291us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.59.126:39255: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":78,"threads_started":1}
I20260812 00:05:33.048023 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 26059
2026-08-12T00:05:33Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (306 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (84 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (87 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:33 dist-test-slave-6nmv krb5kdc[26191](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:33 dist-test-slave-6nmv krb5kdc[26191](info): set up 2 sockets
Aug 12 00:05:33 dist-test-slave-6nmv krb5kdc[26191](info): commencing operation
krb5kdc: starting...
W20260812 00:05:34.302742 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:05:34 dist-test-slave-6nmv krb5kdc[26191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:05:34.420274 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:43605
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:39297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:43605
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:34.496177 26207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:34.496366 26207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:34.496384 26207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:34.497355 26207 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:34.497387 26207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:34.497399 26207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:34.497411 26207 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:34.497421 26207 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:34.498667 26207 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:39297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:43605
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:43605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:34.498839 26207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:34.498993 26207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:34.503459 26213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:34.503502 26212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:34.503551 26207 server_base.cc:1034] running on GCE node
W20260812 00:05:34.503507 26215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:34.503892 26207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:34.504232 26207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:34.505405 26207 hybrid_clock.cc:648] HybridClock initialized: now 1786493134505403 us; error 33 us; skew 500 ppm
Aug 12 00:05:34 dist-test-slave-6nmv krb5kdc[26191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493134, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:34.507957 26207 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:05:34.508430 26207 webserver.cc:460] Webserver started at http://127.19.59.126:41203/ using document root <none> and password file <none>
I20260812 00:05:34.508661 26207 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:34.508726 26207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:34.508877 26207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:34.509895 26207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "5adc8c5af7274ce3b44c547f2fa902e9"
format_stamp: "Formatted at 2026-08-12 00:05:34 on dist-test-slave-6nmv"
server_key: "db94894ac51ca2fe006234505214a58c"
server_key_iv: "075ef343dbe0606149706fd160c589f6"
server_key_version: "encryptionkey@0"
I20260812 00:05:34.510263 26207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "5adc8c5af7274ce3b44c547f2fa902e9"
format_stamp: "Formatted at 2026-08-12 00:05:34 on dist-test-slave-6nmv"
server_key: "db94894ac51ca2fe006234505214a58c"
server_key_iv: "075ef343dbe0606149706fd160c589f6"
server_key_version: "encryptionkey@0"
I20260812 00:05:34.511509 26207 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:34.512195 26224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:34.512358 26207 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:34.512458 26207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "5adc8c5af7274ce3b44c547f2fa902e9"
format_stamp: "Formatted at 2026-08-12 00:05:34 on dist-test-slave-6nmv"
server_key: "db94894ac51ca2fe006234505214a58c"
server_key_iv: "075ef343dbe0606149706fd160c589f6"
server_key_version: "encryptionkey@0"
I20260812 00:05:34.512540 26207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:34.543680 26207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:34.546191 26207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:34.546362 26207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:34.550406 26207 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:43605
I20260812 00:05:34.550472 26286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:43605 every 8 connection(s)
I20260812 00:05:34.550827 26207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:34.551682 26287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:34.554026 26287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9: Bootstrap starting.
I20260812 00:05:34.554600 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 26207
I20260812 00:05:34.554705 26287 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:34.554733 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:34.554952 19693 external_mini_cluster.cc:1428] Setting key f1bea360ef3688d42a481e7a783e8fa6
I20260812 00:05:34.555058 26287 log.cc:824] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:34.555928 26287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9: No bootstrap required, opened a new log
I20260812 00:05:34.558341 26287 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5adc8c5af7274ce3b44c547f2fa902e9" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43605 } }
I20260812 00:05:34.558504 26287 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:34.558547 26287 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5adc8c5af7274ce3b44c547f2fa902e9, State: Initialized, Role: FOLLOWER
I20260812 00:05:34.558683 26287 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5adc8c5af7274ce3b44c547f2fa902e9" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43605 } }
I20260812 00:05:34.558776 26287 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:34.558808 26287 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:34.558852 26287 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:34.559480 26287 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5adc8c5af7274ce3b44c547f2fa902e9" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43605 } }
I20260812 00:05:34.559592 26287 leader_election.cc:302] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5adc8c5af7274ce3b44c547f2fa902e9; no voters:
I20260812 00:05:34.559760 26287 leader_election.cc:288] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:34.559816 26293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:34.559990 26287 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:34.560034 26293 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [term 1 LEADER]: Becoming Leader. State: Replica: 5adc8c5af7274ce3b44c547f2fa902e9, State: Running, Role: LEADER
I20260812 00:05:34.560206 26293 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5adc8c5af7274ce3b44c547f2fa902e9" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43605 } }
I20260812 00:05:34.560570 26294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5adc8c5af7274ce3b44c547f2fa902e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5adc8c5af7274ce3b44c547f2fa902e9" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43605 } } }
I20260812 00:05:34.560648 26294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:34.560820 26295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5adc8c5af7274ce3b44c547f2fa902e9. Latest consensus state: current_term: 1 leader_uuid: "5adc8c5af7274ce3b44c547f2fa902e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5adc8c5af7274ce3b44c547f2fa902e9" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43605 } } }
I20260812 00:05:34.560880 26295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:34.560928 26304 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:34.562346 26304 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 00:05:34 dist-test-slave-6nmv krb5kdc[26191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:34.563898 26304 catalog_manager.cc:1347] Generated new cluster ID: 6fa9da340d75477fafc170e4a3265120
I20260812 00:05:34.563966 26304 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:34.567382 26292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:34.555481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39934 (local address 127.19.59.126:43605)
0812 00:05:34.555627 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:34.555636 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:34.555671 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:05:34.556240 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:34.556248 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:34.556318 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:34.556489 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:34.557030 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:34.558501 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:34.559636 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:34.560262 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:34.560362 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:34.563518 (+ 3156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:34.563522 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:34.563522 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:34.563533 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:34.565648 (+ 2115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:34.566068 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:34.566071 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:34.566071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:34.566185 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:34.566396 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:34.566397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:34.566397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:34.566713 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:34.566892 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:34.567024 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 00:05:34.567172 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":76,"threads_started":1}
I20260812 00:05:34.572731 26304 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:34.573366 26304 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:34.576705 26304 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5adc8c5af7274ce3b44c547f2fa902e9: Generated new TSK 0
I20260812 00:05:34.576896 26304 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:05:34.610066 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:43605
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:39297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:34.691069 26319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:34.691288 26319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:34.691313 26319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:34.692490 26319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:34.692533 26319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:34.692559 26319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:05:34.694146 26319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:39297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:43605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:34.694370 26319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:34.694610 26319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:34.699558 26325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:34.699631 26326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:34.699765 26319 server_base.cc:1034] running on GCE node
W20260812 00:05:34.699566 26328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:34.700111 26319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:34.700394 26319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:34.701561 26319 hybrid_clock.cc:648] HybridClock initialized: now 1786493134701545 us; error 51 us; skew 500 ppm
Aug 12 00:05:34 dist-test-slave-6nmv krb5kdc[26191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493134, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:34.704214 26319 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:05:34.704649 26319 webserver.cc:460] Webserver started at http://127.19.59.65:39833/ using document root <none> and password file <none>
I20260812 00:05:34.704875 26319 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:34.704943 26319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:34.705089 26319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:34.706154 26319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "5327044e13a548a2a4696ffe0119a3b0"
format_stamp: "Formatted at 2026-08-12 00:05:34 on dist-test-slave-6nmv"
server_key: "07fe4235fcec26f002c068ba3c67763d"
server_key_iv: "7f1642080a88d50f0025ae9be074e62a"
server_key_version: "encryptionkey@0"
I20260812 00:05:34.706514 26319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "5327044e13a548a2a4696ffe0119a3b0"
format_stamp: "Formatted at 2026-08-12 00:05:34 on dist-test-slave-6nmv"
server_key: "07fe4235fcec26f002c068ba3c67763d"
server_key_iv: "7f1642080a88d50f0025ae9be074e62a"
server_key_version: "encryptionkey@0"
I20260812 00:05:34.707901 26319 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:34.708690 26337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:34.708889 26319 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:34.708990 26319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "5327044e13a548a2a4696ffe0119a3b0"
format_stamp: "Formatted at 2026-08-12 00:05:34 on dist-test-slave-6nmv"
server_key: "07fe4235fcec26f002c068ba3c67763d"
server_key_iv: "7f1642080a88d50f0025ae9be074e62a"
server_key_version: "encryptionkey@0"
I20260812 00:05:34.709075 26319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:34.716620 26319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:34.718521 26319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:34.718672 26319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:34.718883 26319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:34.719177 26319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:34.719231 26319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:34.719269 26319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:34.719296 26319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:34.725144 26319 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:39457
I20260812 00:05:34.725237 26466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:39457 every 8 connection(s)
I20260812 00:05:34.725533 26319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:05:34 dist-test-slave-6nmv krb5kdc[26191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493134, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:34.734565 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 26319
I20260812 00:05:34.734679 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:34.734752 26292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:34.726350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:55077 (local address 127.19.59.126:43605)
0812 00:05:34.726420 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:34.726422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:34.726627 (+ 205us) server_negotiation.cc:407] Connection header received
0812 00:05:34.727499 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:34.727500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:34.727510 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:34.727566 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:34.728117 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:34.728601 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:34.729551 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:34.729731 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:34.729780 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:34.732070 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:34.732071 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:34.732072 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:34.732078 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:34.733334 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:34.733699 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:34.733700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:34.733700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:34.733750 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:34.734018 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:34.734019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:34.734019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:34.734123 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:34.734175 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:34.734477 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 00:05:34.734627 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 00:05:34.734755 26470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:34.726314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:43605 (local address 127.19.59.65:55077)
0812 00:05:34.726502 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:34.726542 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:34.727409 (+ 867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:34.727624 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:34.727627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:34.727856 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:34.728047 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:34.728051 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:34.728676 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:34.728677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:34.729481 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:34.729483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:34.729899 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:34.729900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:34.730039 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:34.730589 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:34.730605 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:34.731960 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:34.733407 (+ 1447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:34.733414 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:34.733416 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:34.733625 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:34.733847 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:34.733848 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:34.733849 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:34.733959 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:34.734180 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:34.734197 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:34.734299 (+ 102us) client_negotiation.cc:769] Sending connection context
0812 00:05:34.734405 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 00:05:34.734544 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":120,"threads_started":1}
I20260812 00:05:34.734908 19693 external_mini_cluster.cc:1428] Setting key 2dd4681fd6c60cda28ea4290164d5c17
I20260812 00:05:34.735608 26467 heartbeater.cc:347] Connected to a master server at 127.19.59.126:43605
I20260812 00:05:34.735711 26467 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:34.735883 26467 heartbeater.cc:511] Master 127.19.59.126:43605 requested a full tablet report, sending...
I20260812 00:05:34.736454 26244 ts_manager.cc:194] Registered new tserver with Master: 5327044e13a548a2a4696ffe0119a3b0 (127.19.59.65:39457)
I20260812 00:05:34.737013 26244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:55077
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:05:34.758796 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:43605
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:39297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:34.836736 26473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:34.836932 26473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:34.836953 26473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:34.838115 26473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:34.838156 26473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:34.838181 26473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:05:34.839589 26473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:39297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:43605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:34.839772 26473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:34.839939 26473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:34.844846 26480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:34.844873 26482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:34.844873 26479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:34.844969 26473 server_base.cc:1034] running on GCE node
I20260812 00:05:34.845279 26473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:34.845532 26473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:34.846706 26473 hybrid_clock.cc:648] HybridClock initialized: now 1786493134846693 us; error 42 us; skew 500 ppm
Aug 12 00:05:34 dist-test-slave-6nmv krb5kdc[26191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493134, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:34.849272 26473 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:05:34.849642 26473 webserver.cc:460] Webserver started at http://127.19.59.66:40437/ using document root <none> and password file <none>
I20260812 00:05:34.849874 26473 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:34.849923 26473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:34.850013 26473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:34.850952 26473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "1161b911affb45e2a339335d45a06606"
format_stamp: "Formatted at 2026-08-12 00:05:34 on dist-test-slave-6nmv"
server_key: "7cf43fb19b279a9ad3afabcdac19d245"
server_key_iv: "a54eb9daacc7f1d2c1e76675e61a4f1e"
server_key_version: "encryptionkey@0"
I20260812 00:05:34.851236 26473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "1161b911affb45e2a339335d45a06606"
format_stamp: "Formatted at 2026-08-12 00:05:34 on dist-test-slave-6nmv"
server_key: "7cf43fb19b279a9ad3afabcdac19d245"
server_key_iv: "a54eb9daacc7f1d2c1e76675e61a4f1e"
server_key_version: "encryptionkey@0"
I20260812 00:05:34.852546 26473 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:34.853255 26493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:34.853410 26473 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:34.853502 26473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "1161b911affb45e2a339335d45a06606"
format_stamp: "Formatted at 2026-08-12 00:05:34 on dist-test-slave-6nmv"
server_key: "7cf43fb19b279a9ad3afabcdac19d245"
server_key_iv: "a54eb9daacc7f1d2c1e76675e61a4f1e"
server_key_version: "encryptionkey@0"
I20260812 00:05:34.853556 26473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:34.864956 26473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:34.866721 26473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:34.866833 26473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:34.866990 26473 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:34.867216 26473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:34.867271 26473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:34.867304 26473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:34.867316 26473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:34.872852 26473 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:35737
I20260812 00:05:34.872959 26622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:35737 every 8 connection(s)
I20260812 00:05:34.873260 26473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:05:34 dist-test-slave-6nmv krb5kdc[26191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493134, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:34.882567 26292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:34.874088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:39855 (local address 127.19.59.126:43605)
0812 00:05:34.874155 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:34.874157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:34.874362 (+ 205us) server_negotiation.cc:407] Connection header received
0812 00:05:34.875281 (+ 919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:34.875282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:34.875296 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:34.875348 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:34.875953 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:34.876491 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:34.877473 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:34.877681 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:34.877763 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:34.879904 (+ 2141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:34.879905 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:34.879905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:34.879913 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:34.881155 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:34.881540 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:34.881541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:34.881541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:34.881609 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:34.881883 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:34.881884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:34.881884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:34.882006 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:34.882097 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:34.882383 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 00:05:34.882476 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 00:05:34.882766 26625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:34.874010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:43605 (local address 127.19.59.66:39855)
0812 00:05:34.874195 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:34.874235 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:34.875168 (+ 933us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:34.875414 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:34.875426 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:34.875688 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:34.875855 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:34.875860 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:34.876592 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:34.876593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:34.877370 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:34.877372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:34.877774 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:34.877775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:34.877928 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:34.878443 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:34.878451 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:34.879804 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:34.881238 (+ 1434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:34.881246 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:34.881248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:34.881462 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:34.881677 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:34.881678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:34.881678 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:34.881780 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:34.882090 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:34.882097 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:34.882245 (+ 148us) client_negotiation.cc:769] Sending connection context
0812 00:05:34.882346 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 00:05:34.882499 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":97,"threads_started":1}
I20260812 00:05:34.883289 26623 heartbeater.cc:347] Connected to a master server at 127.19.59.126:43605
I20260812 00:05:34.883399 26623 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:34.883419 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 26473
I20260812 00:05:34.883519 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:34.883607 26623 heartbeater.cc:511] Master 127.19.59.126:43605 requested a full tablet report, sending...
I20260812 00:05:34.883746 19693 external_mini_cluster.cc:1428] Setting key 56de159bb10db0b0f98581e78633f86f
I20260812 00:05:34.883996 26244 ts_manager.cc:194] Registered new tserver with Master: 1161b911affb45e2a339335d45a06606 (127.19.59.66:35737)
I20260812 00:05:34.884616 26244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:39855
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:05:34.908718 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:43605
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:39297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:34.985488 26628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:34.985705 26628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:34.985744 26628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:34.986833 26628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:34.986871 26628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:34.986896 26628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:05:34.988201 26628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:39297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:43605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:34.988386 26628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:34.988543 26628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:34.992995 26636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:34.993002 26639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:34.993010 26637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:34.993255 26628 server_base.cc:1034] running on GCE node
I20260812 00:05:34.993438 26628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:34.993664 26628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:34.994798 26628 hybrid_clock.cc:648] HybridClock initialized: now 1786493134994785 us; error 30 us; skew 500 ppm
Aug 12 00:05:34 dist-test-slave-6nmv krb5kdc[26191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493134, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:34.997120 26628 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:05:34.997546 26628 webserver.cc:460] Webserver started at http://127.19.59.67:44755/ using document root <none> and password file <none>
I20260812 00:05:34.997762 26628 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:34.997845 26628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:34.998011 26628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:34.998942 26628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "75a2c4203481419ebebb4c988a65a182"
format_stamp: "Formatted at 2026-08-12 00:05:34 on dist-test-slave-6nmv"
server_key: "91baedd916f1246e7701240bdf082ab4"
server_key_iv: "4f0c22d1338747f1d2402a8cfc5a9b4f"
server_key_version: "encryptionkey@0"
I20260812 00:05:34.999296 26628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "75a2c4203481419ebebb4c988a65a182"
format_stamp: "Formatted at 2026-08-12 00:05:34 on dist-test-slave-6nmv"
server_key: "91baedd916f1246e7701240bdf082ab4"
server_key_iv: "4f0c22d1338747f1d2402a8cfc5a9b4f"
server_key_version: "encryptionkey@0"
I20260812 00:05:35.000567 26628 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:05:35.001263 26651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:35.001434 26628 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:35.001534 26628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "75a2c4203481419ebebb4c988a65a182"
format_stamp: "Formatted at 2026-08-12 00:05:34 on dist-test-slave-6nmv"
server_key: "91baedd916f1246e7701240bdf082ab4"
server_key_iv: "4f0c22d1338747f1d2402a8cfc5a9b4f"
server_key_version: "encryptionkey@0"
I20260812 00:05:35.001616 26628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:35.014775 26628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:35.016590 26628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:35.016746 26628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:35.016966 26628 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:35.017252 26628 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:35.017308 26628 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:35.017345 26628 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:35.017370 26628 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:35.022832 26628 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:41283
I20260812 00:05:35.022881 26780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:41283 every 8 connection(s)
I20260812 00:05:35.023177 26628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:05:35 dist-test-slave-6nmv krb5kdc[26191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493134, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:35.032099 26292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:35.023890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:50093 (local address 127.19.59.126:43605)
0812 00:05:35.023940 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:35.023942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:35.024156 (+ 214us) server_negotiation.cc:407] Connection header received
0812 00:05:35.025180 (+ 1024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:35.025182 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:35.025194 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:35.025254 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:35.025860 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:35.026388 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:35.027352 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:35.027609 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:35.027694 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:35.029732 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:35.029733 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:35.029733 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:35.029740 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:35.030986 (+ 1246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:35.031343 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:35.031344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:35.031344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:35.031394 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:35.031598 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:35.031598 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:35.031599 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:35.031708 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:35.031758 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:35.031974 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 00:05:35.032036 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:05:35.032254 26784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:35.023854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:43605 (local address 127.19.59.67:50093)
0812 00:05:35.024032 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:35.024070 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:35.025070 (+ 1000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:35.025330 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:35.025334 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:35.025578 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:35.025745 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:35.025749 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:35.026494 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:35.026496 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:35.027254 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:35.027256 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:35.027704 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:35.027706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:35.027828 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:35.028250 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:35.028257 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:35.029646 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:35.031061 (+ 1415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:35.031067 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:35.031068 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:35.031278 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:35.031448 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:35.031448 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:35.031449 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:35.031542 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:35.031761 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:35.031765 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:35.031870 (+ 105us) client_negotiation.cc:769] Sending connection context
0812 00:05:35.031947 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:05:35.032068 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":96,"threads_started":1}
I20260812 00:05:35.032794 26782 heartbeater.cc:347] Connected to a master server at 127.19.59.126:43605
I20260812 00:05:35.032897 26782 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:35.033089 26782 heartbeater.cc:511] Master 127.19.59.126:43605 requested a full tablet report, sending...
I20260812 00:05:35.033242 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 26628
I20260812 00:05:35.033360 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:35.033511 26244 ts_manager.cc:194] Registered new tserver with Master: 75a2c4203481419ebebb4c988a65a182 (127.19.59.67:41283)
I20260812 00:05:35.033603 19693 external_mini_cluster.cc:1428] Setting key bb90c7f33cdb0e445d2b0e21f522009e
I20260812 00:05:35.034029 26244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:50093
I20260812 00:05:35.034543 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/test-admin.keytab.
Aug 12 00:05:35 dist-test-slave-6nmv krb5kdc[26191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493135, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:35.050407 19693 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 00:05:35.051970 26790 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:35.051275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57130 (local address 127.19.59.65:39457)
0812 00:05:35.051450 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:35.051455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:35.051464 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:35.051489 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:35.051490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:35.051503 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:35.051588 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:35.051910 (+ 322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57130: BlockingRecv error: recv got EOF from 127.0.0.1:57130 (error 108)
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":97,"threads_started":1}
W20260812 00:05:35.052130 19693 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/krb5cc)
Aug 12 00:05:35 dist-test-slave-6nmv krb5kdc[26191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493135, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:35.053118 19693 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 00:05:35 dist-test-slave-6nmv krb5kdc[26191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493135, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:35.054039 19693 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 00:05:35 dist-test-slave-6nmv krb5kdc[26191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493135, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.65@KRBTEST.COM
I20260812 00:05:35.061875 26790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:35.054539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57136 (local address 127.19.59.65:39457)
0812 00:05:35.054597 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:35.054599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:35.054627 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:05:35.054672 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:35.054673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:35.054681 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:35.054732 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:35.055103 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:35.055815 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:35.056549 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:35.056859 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:35.056913 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:35.059007 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:35.059014 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:35.059014 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:35.059021 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:35.060645 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:35.061066 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:35.061068 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:35.061069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:35.061127 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:35.061352 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:35.061353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:35.061353 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:35.061477 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:35.061593 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:35.061663 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 00:05:35.061728 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260812 00:05:35.063642 26790 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:35.063052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57152 (local address 127.19.59.65:39457)
0812 00:05:35.063110 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:35.063112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:35.063187 (+ 75us) server_negotiation.cc:407] Connection header received
0812 00:05:35.063257 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:35.063257 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:35.063268 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:35.063312 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:35.063596 (+ 284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57152: BlockingRecv error: recv got EOF from 127.0.0.1:57152 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260812 00:05:35.063730 19693 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/krb5cc' of type FILE
Aug 12 00:05:35 dist-test-slave-6nmv krb5kdc[26191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493135, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:35.064644 19693 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 00:05:35 dist-test-slave-6nmv krb5kdc[26191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493135, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:35.065490 19693 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 00:05:35 dist-test-slave-6nmv krb5kdc[26191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493135, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.65@KRBTEST.COM
I20260812 00:05:35.071985 26790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:35.065989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57158 (local address 127.19.59.65:39457)
0812 00:05:35.066044 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:35.066045 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:35.066118 (+ 73us) server_negotiation.cc:407] Connection header received
0812 00:05:35.066151 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:35.066151 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:35.066158 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:35.066200 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:35.066499 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:35.066944 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:35.067593 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:35.067776 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:35.067827 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:35.069655 (+ 1828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:35.069656 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:35.069656 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:35.069662 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:35.071046 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:35.071340 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:35.071341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:35.071341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:35.071389 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:35.071547 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:35.071547 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:35.071547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:35.071644 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:35.071712 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:35.071794 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 00:05:35.071849 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260812 00:05:35.073374 26790 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:35.072935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57174 (local address 127.19.59.65:39457)
0812 00:05:35.072969 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:35.072971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:35.072996 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:05:35.073046 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:35.073047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:35.073054 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:35.073090 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:35.073338 (+ 248us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57174: BlockingRecv error: recv got EOF from 127.0.0.1:57174 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260812 00:05:35.073486 19693 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786493109864389-19693-0/krb5kdc/krb5cc' of type FILE
Aug 12 00:05:35 dist-test-slave-6nmv krb5kdc[26191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493135, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:35.074441 19693 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 00:05:35 dist-test-slave-6nmv krb5kdc[26191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493135, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:35.075245 19693 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 00:05:35 dist-test-slave-6nmv krb5kdc[26191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493135, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.65@KRBTEST.COM
I20260812 00:05:35.081547 26790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:35.075730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57176 (local address 127.19.59.65:39457)
0812 00:05:35.075791 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:35.075792 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:35.075893 (+ 101us) server_negotiation.cc:407] Connection header received
0812 00:05:35.075962 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:35.075963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:35.075982 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:35.076028 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:35.076419 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:35.077054 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:35.077729 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:35.078004 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:35.078075 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:35.079807 (+ 1732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:35.079808 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:35.079808 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:35.079813 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:35.080816 (+ 1003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:35.081083 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:35.081084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:35.081084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:35.081127 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:35.081259 (+ 132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:35.081259 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:35.081259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:35.081324 (+ 65us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:35.081377 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:35.081454 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 00:05:35.081502 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:05:35.082135 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 26319
I20260812 00:05:35.094302 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 26473
I20260812 00:05:35.101219 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 26628
I20260812 00:05:35.107678 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 26207
2026-08-12T00:05:35Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1886 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:35 dist-test-slave-6nmv krb5kdc[26808](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:35 dist-test-slave-6nmv krb5kdc[26808](info): set up 2 sockets
Aug 12 00:05:35 dist-test-slave-6nmv krb5kdc[26808](info): commencing operation
krb5kdc: starting...
W20260812 00:05:36.192729 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:05:36 dist-test-slave-6nmv krb5kdc[26808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:36Z Disabled control of system clock
WARNING: no policy specified for oryx/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.126.keytab.
Entry for principal oryx/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.126.keytab.
I20260812 00:05:36.304579 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:33763
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.126.keytab
--principal=oryx/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:35137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:33763
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:36.381150 26821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:36.381357 26821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:36.381379 26821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:36.382414 26821 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:36.382449 26821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:36.382462 26821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:36.382473 26821 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:36.382484 26821 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:36.383848 26821 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:35137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:33763
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.126.keytab
--principal=oryx/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:33763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:36.384040 26821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:36.384204 26821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:36.388857 26826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:36.388870 26830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:36.388872 26827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:36.389125 26821 server_base.cc:1034] running on GCE node
I20260812 00:05:36.389384 26821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:36.389688 26821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:36.390862 26821 hybrid_clock.cc:648] HybridClock initialized: now 1786493136390841 us; error 62 us; skew 500 ppm
Aug 12 00:05:36 dist-test-slave-6nmv krb5kdc[26808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493136, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:36.393257 26821 init.cc:377] Logged in from keytab as oryx/127.19.59.126@KRBTEST.COM (short username oryx)
I20260812 00:05:36.393726 26821 webserver.cc:460] Webserver started at http://127.19.59.126:42041/ using document root <none> and password file <none>
I20260812 00:05:36.393989 26821 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:36.394061 26821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:36.394210 26821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:36.395211 26821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "78e8fa15aada475f846835f0c2be6035"
format_stamp: "Formatted at 2026-08-12 00:05:36 on dist-test-slave-6nmv"
server_key: "98c2244e4e6aebfbc9bd5073d774b763"
server_key_iv: "3f53f6de630173a312205a90e2c93635"
server_key_version: "encryptionkey@0"
I20260812 00:05:36.395567 26821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "78e8fa15aada475f846835f0c2be6035"
format_stamp: "Formatted at 2026-08-12 00:05:36 on dist-test-slave-6nmv"
server_key: "98c2244e4e6aebfbc9bd5073d774b763"
server_key_iv: "3f53f6de630173a312205a90e2c93635"
server_key_version: "encryptionkey@0"
I20260812 00:05:36.396801 26821 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:36.397461 26837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:36.397627 26821 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:36.397724 26821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "78e8fa15aada475f846835f0c2be6035"
format_stamp: "Formatted at 2026-08-12 00:05:36 on dist-test-slave-6nmv"
server_key: "98c2244e4e6aebfbc9bd5073d774b763"
server_key_iv: "3f53f6de630173a312205a90e2c93635"
server_key_version: "encryptionkey@0"
I20260812 00:05:36.397792 26821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:36.424649 26821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:36.426513 26821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:36.426656 26821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:36.430955 26821 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:33763
I20260812 00:05:36.431046 26893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:33763 every 8 connection(s)
I20260812 00:05:36.431329 26821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:36.432371 26894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:36.434793 26894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035: Bootstrap starting.
I20260812 00:05:36.435389 26894 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:36.435685 26894 log.cc:824] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:36.436388 26894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035: No bootstrap required, opened a new log
I20260812 00:05:36.438017 26894 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } }
I20260812 00:05:36.438150 26894 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:36.438207 26894 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78e8fa15aada475f846835f0c2be6035, State: Initialized, Role: FOLLOWER
I20260812 00:05:36.438369 26894 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } }
I20260812 00:05:36.438429 26894 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:36.438473 26894 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:36.438522 26894 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:36.438750 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 26821
I20260812 00:05:36.438862 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:36.439090 19693 external_mini_cluster.cc:1428] Setting key b2e80e646440c1d1e3977a59fd5e9d49
I20260812 00:05:36.439594 26894 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } }
I20260812 00:05:36.439709 26894 leader_election.cc:302] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78e8fa15aada475f846835f0c2be6035; no voters:
I20260812 00:05:36.439877 26894 leader_election.cc:288] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:36.439913 26899 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:36.440054 26899 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [term 1 LEADER]: Becoming Leader. State: Replica: 78e8fa15aada475f846835f0c2be6035, State: Running, Role: LEADER
I20260812 00:05:36.440172 26894 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:36.440192 26899 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } }
I20260812 00:05:36.440578 26899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78e8fa15aada475f846835f0c2be6035. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } }
I20260812 00:05:36.440871 26899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:36.440771 26900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } }
I20260812 00:05:36.441089 26900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:36.441286 26909 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:36.441840 26909 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:36.443368 26909 catalog_manager.cc:1347] Generated new cluster ID: e7ca53663266458c8d1ef8eb5e858a52
I20260812 00:05:36.443419 26909 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:05:36 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
I20260812 00:05:36.450986 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:36.439568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50426 (local address 127.19.59.126:33763)
0812 00:05:36.439784 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:36.439794 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:36.439829 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:05:36.439963 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:36.439971 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:36.440025 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:36.440990 (+ 965us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:36.441078 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:36.442666 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:36.443737 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:36.444306 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:36.444415 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:36.447237 (+ 2822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:36.447241 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:36.447241 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:36.447253 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:36.449293 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:36.449699 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:36.449703 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:36.449703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:36.449919 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:36.450131 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:36.450132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:36.450132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:36.450433 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:36.450620 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:36.450683 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 00:05:36.450804 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":117,"threads_started":1}
I20260812 00:05:36.453186 26909 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:36.453936 26909 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:36.460505 26909 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035: Generated new TSK 0
I20260812 00:05:36.460657 26909 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.65.keytab.
Entry for principal oryx/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.65.keytab.
I20260812 00:05:36.487901 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:33763
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.65.keytab
--principal=oryx/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:35137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:36.567040 26923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:36.567221 26923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:36.567242 26923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:36.568234 26923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:36.568271 26923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:36.568293 26923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:05:36.569603 26923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:35137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.65.keytab
--principal=oryx/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:33763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:36.569840 26923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:36.570073 26923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:36.575071 26930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:36.575109 26923 server_base.cc:1034] running on GCE node
W20260812 00:05:36.575109 26932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:36.575080 26929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:36.575489 26923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:36.575759 26923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:36.576924 26923 hybrid_clock.cc:648] HybridClock initialized: now 1786493136576911 us; error 24 us; skew 500 ppm
Aug 12 00:05:36 dist-test-slave-6nmv krb5kdc[26808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493136, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:36.579475 26923 init.cc:377] Logged in from keytab as oryx/127.19.59.65@KRBTEST.COM (short username oryx)
I20260812 00:05:36.579850 26923 webserver.cc:460] Webserver started at http://127.19.59.65:45557/ using document root <none> and password file <none>
I20260812 00:05:36.580056 26923 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:36.580127 26923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:36.580248 26923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:36.581177 26923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "ae39907b6a21452a9ac2e681fac637e0"
format_stamp: "Formatted at 2026-08-12 00:05:36 on dist-test-slave-6nmv"
server_key: "d617faccba78da53a76eda8ddfbcc7fb"
server_key_iv: "f023b5a70cc8f04ddc8bb326591c26c5"
server_key_version: "encryptionkey@0"
I20260812 00:05:36.581547 26923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "ae39907b6a21452a9ac2e681fac637e0"
format_stamp: "Formatted at 2026-08-12 00:05:36 on dist-test-slave-6nmv"
server_key: "d617faccba78da53a76eda8ddfbcc7fb"
server_key_iv: "f023b5a70cc8f04ddc8bb326591c26c5"
server_key_version: "encryptionkey@0"
I20260812 00:05:36.582813 26923 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:36.583516 26943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:36.583681 26923 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:36.583779 26923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "ae39907b6a21452a9ac2e681fac637e0"
format_stamp: "Formatted at 2026-08-12 00:05:36 on dist-test-slave-6nmv"
server_key: "d617faccba78da53a76eda8ddfbcc7fb"
server_key_iv: "f023b5a70cc8f04ddc8bb326591c26c5"
server_key_version: "encryptionkey@0"
I20260812 00:05:36.583859 26923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:36.595963 26923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:36.597513 26923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:36.597676 26923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:36.597899 26923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:36.598176 26923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:36.598227 26923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:36.598263 26923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:36.598289 26923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:36.605285 26923 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:32951
I20260812 00:05:36.605638 26923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:05:36.611665 27080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:32951 every 8 connection(s)
I20260812 00:05:36.612344 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 26923
I20260812 00:05:36.612460 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:36.612637 19693 external_mini_cluster.cc:1428] Setting key fc3dd0e69052f0798d44f0a7f596edd1
Aug 12 00:05:36 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493136, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
I20260812 00:05:36.621223 27085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:36.611885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.65:59555)
0812 00:05:36.612561 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:36.612594 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:36.613275 (+ 681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:36.613560 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:36.613564 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:36.614307 (+ 743us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:36.614511 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:36.614516 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:36.615142 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:36.615144 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:36.615870 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:36.615871 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:36.616299 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:36.616300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:36.616396 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:36.616892 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:36.616899 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:36.618304 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:36.619996 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:36.620001 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:36.620003 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:36.620196 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:36.620404 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:36.620404 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:36.620404 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:36.620491 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:36.620765 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:36.620769 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:36.620878 (+ 109us) client_negotiation.cc:769] Sending connection context
0812 00:05:36.620960 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 00:05:36.621064 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":87,"threads_started":1}
I20260812 00:05:36.621281 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:36.611999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:59555 (local address 127.19.59.126:33763)
0812 00:05:36.612061 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:36.612064 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:36.612697 (+ 633us) server_negotiation.cc:407] Connection header received
0812 00:05:36.613419 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:36.613420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:36.613436 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:36.613494 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:36.614599 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:36.615053 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:36.615960 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:36.616223 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:36.616282 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:36.618391 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:36.618400 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:36.618401 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:36.618408 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:36.619921 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:36.620269 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:36.620270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:36.620271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:36.620341 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:36.620552 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:36.620553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:36.620553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:36.620699 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:36.620772 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:36.621001 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 00:05:36.621089 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
WARNING: no policy specified for oryx/127.19.59.66@KRBTEST.COM; defaulting to no policy
I20260812 00:05:36.621740 27081 heartbeater.cc:347] Connected to a master server at 127.19.59.126:33763
I20260812 00:05:36.621874 27081 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:36.622033 27081 heartbeater.cc:511] Master 127.19.59.126:33763 requested a full tablet report, sending...
I20260812 00:05:36.622541 26854 ts_manager.cc:194] Registered new tserver with Master: ae39907b6a21452a9ac2e681fac637e0 (127.19.59.65:32951)
I20260812 00:05:36.623076 26854 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:59555
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.66.keytab.
Entry for principal oryx/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.66.keytab.
I20260812 00:05:36.639019 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:33763
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.66.keytab
--principal=oryx/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:35137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:36.718605 27090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:36.718817 27090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:36.718853 27090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:36.719980 27090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:36.720041 27090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:36.720086 27090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:05:36.721433 27090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:35137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.66.keytab
--principal=oryx/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:33763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:36.721670 27090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:36.721954 27090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:36.726603 27100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:36.726619 27098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:36.726603 27096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:36.726876 27090 server_base.cc:1034] running on GCE node
I20260812 00:05:36.727070 27090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:36.727306 27090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:36.728469 27090 hybrid_clock.cc:648] HybridClock initialized: now 1786493136728456 us; error 24 us; skew 500 ppm
Aug 12 00:05:36 dist-test-slave-6nmv krb5kdc[26808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493136, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:36.730927 27090 init.cc:377] Logged in from keytab as oryx/127.19.59.66@KRBTEST.COM (short username oryx)
I20260812 00:05:36.731427 27090 webserver.cc:460] Webserver started at http://127.19.59.66:34465/ using document root <none> and password file <none>
I20260812 00:05:36.731673 27090 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:36.731742 27090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:36.731884 27090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:36.732904 27090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "174dac5782ea46e8b1b4072405f00c1d"
format_stamp: "Formatted at 2026-08-12 00:05:36 on dist-test-slave-6nmv"
server_key: "3b32e1264479adefa642d490aa3efa83"
server_key_iv: "b0ebf10457b300328291fd78aaa83747"
server_key_version: "encryptionkey@0"
I20260812 00:05:36.733278 27090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "174dac5782ea46e8b1b4072405f00c1d"
format_stamp: "Formatted at 2026-08-12 00:05:36 on dist-test-slave-6nmv"
server_key: "3b32e1264479adefa642d490aa3efa83"
server_key_iv: "b0ebf10457b300328291fd78aaa83747"
server_key_version: "encryptionkey@0"
I20260812 00:05:36.734613 27090 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:36.735311 27108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:36.735495 27090 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:36.735590 27090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "174dac5782ea46e8b1b4072405f00c1d"
format_stamp: "Formatted at 2026-08-12 00:05:36 on dist-test-slave-6nmv"
server_key: "3b32e1264479adefa642d490aa3efa83"
server_key_iv: "b0ebf10457b300328291fd78aaa83747"
server_key_version: "encryptionkey@0"
I20260812 00:05:36.735666 27090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:36.750976 27090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:36.752689 27090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:36.752851 27090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:36.753057 27090 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:36.753350 27090 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:36.753413 27090 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:36.753450 27090 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:36.753479 27090 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:36.759307 27090 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:33557
I20260812 00:05:36.759341 27241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:33557 every 8 connection(s)
I20260812 00:05:36.759654 27090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:36.763703 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 27090
I20260812 00:05:36.763808 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:36.764038 19693 external_mini_cluster.cc:1428] Setting key 1118cb0c6e5387c58c68feba8014d0a9
Aug 12 00:05:36 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493136, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
I20260812 00:05:36.768738 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:36.760317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:49183 (local address 127.19.59.126:33763)
0812 00:05:36.760391 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:36.760393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:36.760522 (+ 129us) server_negotiation.cc:407] Connection header received
0812 00:05:36.760920 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:36.760920 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:36.760931 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:36.761001 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:36.761932 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:36.762464 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:36.763363 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:36.763615 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:36.763689 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:36.765833 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:36.765835 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:36.765835 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:36.765841 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:36.767333 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:36.767818 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:36.767819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:36.767819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:36.767870 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:36.768148 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:36.768149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:36.768149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:36.768244 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:36.768293 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:36.768616 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 00:05:36.768678 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 00:05:36.769045 27245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:36.760264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.66:49183)
0812 00:05:36.760417 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:36.760447 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:36.760840 (+ 393us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:36.761047 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:36.761050 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:36.761580 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:36.761776 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:36.761779 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:36.762533 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:36.762533 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:36.763287 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:36.763289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:36.763706 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:36.763706 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:36.763838 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:36.764393 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:36.764402 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:36.765723 (+ 1321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:36.767432 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:36.767438 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:36.767440 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:36.767740 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:36.767943 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:36.767943 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:36.767944 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:36.768089 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:36.768306 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:36.768312 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:36.768466 (+ 154us) client_negotiation.cc:769] Sending connection context
0812 00:05:36.768594 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 00:05:36.768783 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":87,"threads_started":1}
I20260812 00:05:36.769536 27243 heartbeater.cc:347] Connected to a master server at 127.19.59.126:33763
I20260812 00:05:36.769631 27243 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:36.769847 27243 heartbeater.cc:511] Master 127.19.59.126:33763 requested a full tablet report, sending...
I20260812 00:05:36.770246 26854 ts_manager.cc:194] Registered new tserver with Master: 174dac5782ea46e8b1b4072405f00c1d (127.19.59.66:33557)
I20260812 00:05:36.770619 26854 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:49183
WARNING: no policy specified for oryx/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.67.keytab.
Entry for principal oryx/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.67.keytab.
I20260812 00:05:36.790091 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:33763
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.67.keytab
--principal=oryx/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:35137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:36.867204 27249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:36.867470 27249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:36.867511 27249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:36.868652 27249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:36.868734 27249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:36.868778 27249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:05:36.870258 27249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:35137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.67.keytab
--principal=oryx/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:33763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:36.870537 27249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:36.870769 27249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:36.875789 27258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:36.875794 27254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:36.875820 27256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:36.876142 27249 server_base.cc:1034] running on GCE node
I20260812 00:05:36.876369 27249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:36.876641 27249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:36.877799 27249 hybrid_clock.cc:648] HybridClock initialized: now 1786493136877775 us; error 40 us; skew 500 ppm
Aug 12 00:05:36 dist-test-slave-6nmv krb5kdc[26808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493136, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:36.880544 27249 init.cc:377] Logged in from keytab as oryx/127.19.59.67@KRBTEST.COM (short username oryx)
I20260812 00:05:36.881021 27249 webserver.cc:460] Webserver started at http://127.19.59.67:34579/ using document root <none> and password file <none>
I20260812 00:05:36.881258 27249 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:36.881304 27249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:36.881467 27249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:36.882615 27249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "8eebdc48423143e1a400d6ea0c47007a"
format_stamp: "Formatted at 2026-08-12 00:05:36 on dist-test-slave-6nmv"
server_key: "423b1eac732d90e398cd0d30cf91d7e2"
server_key_iv: "1176131c32ee785d0a4dfcd46a595ba6"
server_key_version: "encryptionkey@0"
I20260812 00:05:36.882989 27249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "8eebdc48423143e1a400d6ea0c47007a"
format_stamp: "Formatted at 2026-08-12 00:05:36 on dist-test-slave-6nmv"
server_key: "423b1eac732d90e398cd0d30cf91d7e2"
server_key_iv: "1176131c32ee785d0a4dfcd46a595ba6"
server_key_version: "encryptionkey@0"
I20260812 00:05:36.884364 27249 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:36.885087 27265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:36.885262 27249 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:36.885363 27249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "8eebdc48423143e1a400d6ea0c47007a"
format_stamp: "Formatted at 2026-08-12 00:05:36 on dist-test-slave-6nmv"
server_key: "423b1eac732d90e398cd0d30cf91d7e2"
server_key_iv: "1176131c32ee785d0a4dfcd46a595ba6"
server_key_version: "encryptionkey@0"
I20260812 00:05:36.885447 27249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:36.897249 27249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:36.899041 27249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:36.899194 27249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:36.899381 27249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:36.899668 27249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:36.899718 27249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:36.899753 27249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:36.899777 27249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:36.905412 27249 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:38373
I20260812 00:05:36.905496 27392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:38373 every 8 connection(s)
I20260812 00:05:36.905759 27249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:05:36 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493136, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
I20260812 00:05:36.914543 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:36.906463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:39135 (local address 127.19.59.126:33763)
0812 00:05:36.906499 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:36.906501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:36.906701 (+ 200us) server_negotiation.cc:407] Connection header received
0812 00:05:36.907190 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:36.907192 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:36.907205 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:36.907273 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:36.908167 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:36.908634 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:36.909607 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:36.909885 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:36.909970 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:36.911891 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:36.911892 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:36.911892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:36.911899 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:36.913323 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:36.913671 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:36.913672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:36.913672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:36.913723 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:36.913999 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:36.914000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:36.914000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:36.914103 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:36.914158 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:36.914406 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 00:05:36.914485 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 00:05:36.914582 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 27249
I20260812 00:05:36.914675 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:36.914803 27395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:36.906430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.67:39135)
0812 00:05:36.906577 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:36.906609 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:36.907072 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:36.907330 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:36.907334 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:36.907861 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:36.908053 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:36.908069 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:36.908725 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:36.908726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:36.909513 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:36.909515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:36.909981 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:36.909982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:36.910128 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:36.910526 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:36.910533 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:36.911806 (+ 1273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:36.913398 (+ 1592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:36.913404 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:36.913405 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:36.913607 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:36.913783 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:36.913783 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:36.913783 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:36.913941 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:36.914163 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:36.914168 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:36.914272 (+ 104us) client_negotiation.cc:769] Sending connection context
0812 00:05:36.914349 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:05:36.914559 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":66,"threads_started":1}
I20260812 00:05:36.914897 19693 external_mini_cluster.cc:1428] Setting key 681134865907bac9b2e7271ae5bbfdc8
I20260812 00:05:36.915413 27393 heartbeater.cc:347] Connected to a master server at 127.19.59.126:33763
I20260812 00:05:36.915518 27393 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:36.915726 27393 heartbeater.cc:511] Master 127.19.59.126:33763 requested a full tablet report, sending...
I20260812 00:05:36.916129 26854 ts_manager.cc:194] Registered new tserver with Master: 8eebdc48423143e1a400d6ea0c47007a (127.19.59.67:38373)
I20260812 00:05:36.916514 26854 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:39135
I20260812 00:05:36.926575 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.19.59.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.59.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.59.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.125.keytab.
Entry for principal oryx/127.19.59.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.125.keytab.
I20260812 00:05:36.950296 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.125:45521
--webserver_interface=127.19.59.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.125.keytab
--principal=oryx/127.19.59.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:35137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:33763,127.19.59.125:45521
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:37.030692 27399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:37.030897 27399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:37.030921 27399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:37.032207 27399 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:37.032255 27399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:37.032270 27399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:37.032284 27399 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:37.032295 27399 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:37.033780 27399 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:35137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:33763,127.19.59.125:45521
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.125.keytab
--principal=oryx/127.19.59.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.125:45521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.59.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
W20260812 00:05:37.033907 27399 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.59.126:33763,127.19.59.125:45521'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 00:05:37.034082 27399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:37.034322 27399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:37.039108 27406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:37.039106 27408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:37.039125 27399 server_base.cc:1034] running on GCE node
W20260812 00:05:37.039112 27405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:37.039630 27399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:37.039955 27399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:37.041119 27399 hybrid_clock.cc:648] HybridClock initialized: now 1786493137041117 us; error 38 us; skew 500 ppm
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:37.043617 27399 init.cc:377] Logged in from keytab as oryx/127.19.59.125@KRBTEST.COM (short username oryx)
I20260812 00:05:37.044099 27399 webserver.cc:460] Webserver started at http://127.19.59.125:39845/ using document root <none> and password file <none>
I20260812 00:05:37.044327 27399 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:37.044394 27399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:37.044543 27399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:37.045524 27399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/data/instance:
uuid: "b8da70b1a5604714bce6b4bad8d0c23a"
format_stamp: "Formatted at 2026-08-12 00:05:37 on dist-test-slave-6nmv"
server_key: "0312a2445cd488153743221222ac925a"
server_key_iv: "4d097eedaf609a2fb01e6c3e934f9403"
server_key_version: "encryptionkey@0"
I20260812 00:05:37.045799 27399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/wal/instance:
uuid: "b8da70b1a5604714bce6b4bad8d0c23a"
format_stamp: "Formatted at 2026-08-12 00:05:37 on dist-test-slave-6nmv"
server_key: "0312a2445cd488153743221222ac925a"
server_key_iv: "4d097eedaf609a2fb01e6c3e934f9403"
server_key_version: "encryptionkey@0"
I20260812 00:05:37.047230 27399 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:37.048002 27416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.048216 27399 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:37.048309 27399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/wal
uuid: "b8da70b1a5604714bce6b4bad8d0c23a"
format_stamp: "Formatted at 2026-08-12 00:05:37 on dist-test-slave-6nmv"
server_key: "0312a2445cd488153743221222ac925a"
server_key_iv: "4d097eedaf609a2fb01e6c3e934f9403"
server_key_version: "encryptionkey@0"
I20260812 00:05:37.048370 27399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:37.061174 27399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:37.063684 27399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:37.063802 27399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:37.067868 27399 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.125:45521
I20260812 00:05:37.067940 27476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.125:45521 every 8 connection(s)
I20260812 00:05:37.068306 27399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/data/info.pb
I20260812 00:05:37.069259 27477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:37.070819 27477 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:05:37.074966 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 27399
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.125@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
I20260812 00:05:37.080376 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.071538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50442 (local address 127.19.59.126:33763)
0812 00:05:37.071639 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.071641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.071837 (+ 196us) server_negotiation.cc:407] Connection header received
0812 00:05:37.072360 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.072362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.072374 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.072430 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.073046 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.073548 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.074626 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.074857 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.074941 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.077163 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.077164 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.077165 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.077172 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.078849 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.079371 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.079372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.079373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.079429 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.079715 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.079716 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.079716 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.079844 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.079894 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.080244 (+ 350us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.080315 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 00:05:37.080607 27479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.071488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.0.0.1:50442)
0812 00:05:37.071712 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.071756 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.072249 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.072502 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.072506 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.072750 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.072939 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.072943 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.073652 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.073653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.074520 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.074522 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.074954 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.074955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.075114 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.075610 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.075618 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.077072 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.078942 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.078950 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.078952 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.079280 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.079497 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.079498 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.079499 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.079643 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.079915 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.079924 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.080101 (+ 177us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.080223 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.080384 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":117,"threads_started":1}
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.59.125@KRBTEST.COM
I20260812 00:05:37.081357 27477 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:05:37.084878 27481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.075486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53806 (local address 127.19.59.125:45521)
0812 00:05:37.075680 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.075684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.075703 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:05:37.075729 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.075730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.075749 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.075817 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.076358 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.077146 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.078155 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.078643 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.078724 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.081880 (+ 3156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.081888 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.081888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.081895 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.083671 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.084026 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.084028 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.084029 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.084096 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.084300 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.084301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.084301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.084459 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.084624 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.084689 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.084776 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":101,"threads_started":1}
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.125@KRBTEST.COM for oryx/127.19.59.125@KRBTEST.COM
I20260812 00:05:37.088843 27479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.081608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:45521 (local address 127.0.0.1:53814)
0812 00:05:37.081650 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.081659 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.081704 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.082017 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.082018 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.082203 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.082262 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.082264 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.083183 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.083184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.083690 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.083692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.084112 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.084113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.084180 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.084600 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.084605 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.086420 (+ 1815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.087866 (+ 1446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.087868 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.087868 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.088029 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.088227 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.088228 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.088228 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.088279 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.088546 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.088546 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.088579 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.088636 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.088741 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 00:05:37.088935 27482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.081691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53814 (local address 127.19.59.125:45521)
0812 00:05:37.081880 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.081882 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.081892 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:37.081916 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.081916 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.081928 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.081999 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.082371 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.083083 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.083801 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.084020 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.084113 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.086544 (+ 2431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.086545 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.086546 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.086553 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.087786 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.088106 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.088107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.088107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.088163 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.088388 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.088389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.088389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.088484 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.088554 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.088670 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.088790 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":111,"thread_start_us":88,"threads_started":1}
I20260812 00:05:37.090363 27477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: Bootstrap starting.
I20260812 00:05:37.090968 27477 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:37.091230 27477 log.cc:824] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:37.091931 27477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: No bootstrap required, opened a new log
I20260812 00:05:37.093253 27477 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } }
I20260812 00:05:37.093379 27477 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:37.093400 27477 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8da70b1a5604714bce6b4bad8d0c23a, State: Initialized, Role: FOLLOWER
I20260812 00:05:37.093524 27477 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } }
I20260812 00:05:37.093796 27484 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } } }
I20260812 00:05:37.093863 27477 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:37.093998 27484 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:05:37.095629 27495 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:05:37.095692 27495 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:05:37.097507 27399 master_runner.cc:428] Detected that this master b8da70b1a5604714bce6b4bad8d0c23a is joining an existing cluster
I20260812 00:05:37.097584 27399 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.59.125:45521
I20260812 00:05:37.105705 27482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.098784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53828 (local address 127.19.59.125:45521)
0812 00:05:37.098820 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.098822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.099060 (+ 238us) server_negotiation.cc:407] Connection header received
0812 00:05:37.099133 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.099134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.099142 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.099196 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.099578 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.100083 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.101162 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.101474 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.101557 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.102755 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.102756 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.102756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.102761 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.104400 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.104916 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.104917 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.104918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.104994 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.105182 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.105183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.105183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.105298 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.105397 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.105533 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.105613 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:05:37.105831 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.098696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50458 (local address 127.19.59.126:33763)
0812 00:05:37.098739 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.098741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.098945 (+ 204us) server_negotiation.cc:407] Connection header received
0812 00:05:37.098971 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.098971 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.098981 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.099046 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.099509 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.100288 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.101258 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.101468 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.101573 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.102759 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.102760 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.102761 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.102767 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.104430 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.104945 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.104946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.104946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.105029 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.105253 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.105254 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.105254 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.105410 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.105506 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.105648 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.105721 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:05:37.106026 27503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.098624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.0.0.1:50458)
0812 00:05:37.098849 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.098878 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.098934 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.099069 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.099070 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.099320 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.099416 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.099418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.100381 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.100382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.101138 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.101140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.101605 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.101606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.101666 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.102260 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.102264 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.102644 (+ 380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.104578 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.104579 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.104579 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.104846 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.105113 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.105114 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.105114 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.105188 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.105500 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.105500 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.105532 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.105601 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.105676 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"spinlock_wait_cycles":9088,"thread_start_us":119,"threads_started":1}
I20260812 00:05:37.106436 27502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.098636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:45521 (local address 127.0.0.1:53828)
0812 00:05:37.098995 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.099002 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.099078 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.099210 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.099211 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.099411 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.099464 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.099466 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.100191 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.100192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.101075 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.101077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.101612 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.101613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.101664 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.102199 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.102204 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.102661 (+ 457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.104506 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.104507 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.104508 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.104839 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.105071 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.105072 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.105072 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.105133 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.105391 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.105391 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.105428 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.106044 (+ 616us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.106144 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":88,"threads_started":1}
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493136, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.126@KRBTEST.COM for oryx/127.19.59.125@KRBTEST.COM
I20260812 00:05:37.115018 27504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.108257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:45521 (local address 127.0.0.1:53836)
0812 00:05:37.108361 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.108407 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.108492 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.108601 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.108604 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.108865 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.108920 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.108922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.109479 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.109480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.110132 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.110134 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.110471 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.110472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.110567 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.111021 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.111025 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.112301 (+ 1276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.113997 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.114003 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.114005 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.114201 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.114404 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.114405 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.114405 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.114472 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.114709 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.114715 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.114751 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.114806 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.114940 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":54,"threads_started":1}
I20260812 00:05:37.115020 27482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.108308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53836 (local address 127.19.59.125:45521)
0812 00:05:37.108342 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.108344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.108470 (+ 126us) server_negotiation.cc:407] Connection header received
0812 00:05:37.108548 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.108549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.108557 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.108598 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.109003 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.109397 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.110213 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.110401 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.110469 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.112382 (+ 1913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.112383 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.112383 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.112401 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.113922 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.114275 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.114276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.114276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.114335 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.114541 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.114541 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.114542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.114651 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.114712 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.114863 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.114945 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:05:37.115576 26854 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.59.125:45521: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a"
member_type: NON_VOTER
last_known_addr {
host: "127.19.59.125"
port: 45521
}
attrs {
promote: true
}
}
dest_uuid: "78e8fa15aada475f846835f0c2be6035"
cas_config_opid_index: -1
I20260812 00:05:37.115864 26854 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: NON_VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: true } }
I20260812 00:05:37.116343 27506 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER b8da70b1a5604714bce6b4bad8d0c23a (127.19.59.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: NON_VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: true } } }
I20260812 00:05:37.116600 27447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:37.117410 27506 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.59.125:45521
I20260812 00:05:37.117486 27447 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 1 FOLLOWER]: Refusing update from remote peer 78e8fa15aada475f846835f0c2be6035: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 00:05:37.117635 27505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: NON_VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: true } } }
I20260812 00:05:37.117707 27505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:37.117741 27506 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: NON_VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:37.117786 27399 master.cc:537] Master@127.19.59.125:45521 shutting down...
W20260812 00:05:37.119236 26840 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260812 00:05:37.119684 26840 consensus_peers.cc:487] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 -> Peer b8da70b1a5604714bce6b4bad8d0c23a (127.19.59.125:45521): Couldn't send request to peer b8da70b1a5604714bce6b4bad8d0c23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 00:05:37.120553 27399 raft_consensus.cc:2229] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:37.120644 27399 raft_consensus.cc:2258] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:37.120692 27399 tablet_replica.cc:330] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: stopping tablet replica
I20260812 00:05:37.122948 27399 master.cc:552] Master@127.19.59.125:45521 shutdown complete.
I20260812 00:05:37.122991 27399 master_runner.cc:305] Clearing existing system tablet
I20260812 00:05:37.123116 27399 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:37.123170 27399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:37.123771 27399 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:37.124248 27511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.124426 27399 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:37.124503 27399 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.124543 27399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/wal
uuid: "b8da70b1a5604714bce6b4bad8d0c23a"
format_stamp: "Formatted at 2026-08-12 00:05:37 on dist-test-slave-6nmv"
server_key: "0312a2445cd488153743221222ac925a"
server_key_iv: "4d097eedaf609a2fb01e6c3e934f9403"
server_key_version: "encryptionkey@0"
I20260812 00:05:37.125070 27399 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:37.126334 27399 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 00:05:37.126428 27399 log.cc:1196] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 00:05:37.126612 27399 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: Deleting consensus metadata
I20260812 00:05:37.126744 27399 master_runner.cc:315] Copying system tablet from 127.19.59.126:33763
I20260812 00:05:37.127267 27399 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: tablet copy: Beginning tablet copy session from remote peer at address 127.19.59.126:33763
I20260812 00:05:37.132998 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.127587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50460 (local address 127.19.59.126:33763)
0812 00:05:37.127623 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.127624 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.127748 (+ 124us) server_negotiation.cc:407] Connection header received
0812 00:05:37.127772 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.127773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.127782 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.127845 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.128100 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.128795 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.129506 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.129785 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.129885 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.130653 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.130654 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.130655 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.130661 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.131993 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.132345 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.132346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.132346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.132409 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.132603 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.132604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.132604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.132693 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.132742 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.132900 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.132949 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:05:37.133068 27520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.127522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.0.0.1:50460)
0812 00:05:37.127670 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.127685 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.127736 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.127854 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.127855 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.127978 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.128035 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.128036 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.128868 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.128869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.129431 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.129433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.129893 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.129894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.129938 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.130318 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.130322 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.130583 (+ 261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.132082 (+ 1499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.132083 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.132083 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.132276 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.132481 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.132481 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.132482 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.132544 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.132753 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.132753 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.132817 (+ 64us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.132886 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.132974 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":75,"threads_started":1}
I20260812 00:05:37.133324 26875 tablet_copy_service.cc:140] P 78e8fa15aada475f846835f0c2be6035: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer b8da70b1a5604714bce6b4bad8d0c23a ({username='oryx', principal='oryx/127.19.59.125@KRBTEST.COM'} at 127.0.0.1:50460)
I20260812 00:05:37.133406 26875 tablet_copy_service.cc:161] P 78e8fa15aada475f846835f0c2be6035: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer b8da70b1a5604714bce6b4bad8d0c23a at {username='oryx', principal='oryx/127.19.59.125@KRBTEST.COM'} at 127.0.0.1:50460: session id = b8da70b1a5604714bce6b4bad8d0c23a-00000000000000000000000000000000
I20260812 00:05:37.134199 26875 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 00:05:37.134760 27399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 00:05:37.135550 27399 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: tablet copy: Starting download of 0 data blocks...
I20260812 00:05:37.135721 27399 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: tablet copy: Starting download of 1 WAL segments...
I20260812 00:05:37.136435 27399 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 00:05:37.137128 26875 tablet_copy_service.cc:342] P 78e8fa15aada475f846835f0c2be6035: Request end of tablet copy session b8da70b1a5604714bce6b4bad8d0c23a-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.19.59.125@KRBTEST.COM'} at 127.0.0.1:50460
I20260812 00:05:37.137182 26875 tablet_copy_service.cc:433] P 78e8fa15aada475f846835f0c2be6035: ending tablet copy session b8da70b1a5604714bce6b4bad8d0c23a-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer b8da70b1a5604714bce6b4bad8d0c23a
I20260812 00:05:37.139367 27399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:37.140492 27521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:37.140506 27522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:37.142793 27525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:37.142839 27399 server_base.cc:1034] running on GCE node
I20260812 00:05:37.142997 27399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:37.143157 27399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:37.144269 27399 hybrid_clock.cc:648] HybridClock initialized: now 1786493137144253 us; error 34 us; skew 500 ppm
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:37.145628 27399 init.cc:377] Logged in from keytab as oryx/127.19.59.125@KRBTEST.COM (short username oryx)
I20260812 00:05:37.145895 27399 webserver.cc:460] Webserver started at http://127.19.59.125:44879/ using document root <none> and password file <none>
I20260812 00:05:37.146013 27399 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:37.146055 27399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:37.146720 27399 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:37.147311 27532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.147519 27399 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:37.147572 27399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/wal
uuid: "b8da70b1a5604714bce6b4bad8d0c23a"
format_stamp: "Formatted at 2026-08-12 00:05:37 on dist-test-slave-6nmv"
server_key: "0312a2445cd488153743221222ac925a"
server_key_iv: "4d097eedaf609a2fb01e6c3e934f9403"
server_key_version: "encryptionkey@0"
I20260812 00:05:37.147624 27399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:37.213709 27399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:37.215728 27399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:37.219657 27399 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.125:45521
I20260812 00:05:37.219864 27592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.125:45521 every 8 connection(s)
I20260812 00:05:37.220155 27399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-1/data/info.pb
I20260812 00:05:37.220976 27593 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:05:37.221423 27593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: Bootstrap starting.
I20260812 00:05:37.223857 27593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:05:37.224108 27593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: Bootstrap complete.
I20260812 00:05:37.224318 27593 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: NON_VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: true } }
I20260812 00:05:37.224406 27593 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b8da70b1a5604714bce6b4bad8d0c23a, State: Initialized, Role: LEARNER
I20260812 00:05:37.224462 27593 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: NON_VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: true } }
I20260812 00:05:37.224622 27593 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:37.224619 27596 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: NON_VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: true } } }
I20260812 00:05:37.224709 27596 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: This master's current role is: LEARNER
I20260812 00:05:37.226117 27607 catalog_manager.cc:1259] Loaded cluster ID: e7ca53663266458c8d1ef8eb5e858a52
I20260812 00:05:37.226174 27607 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: loading cluster ID for follower catalog manager: success
I20260812 00:05:37.227154 27607 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: acquiring CA information for follower catalog manager: success
I20260812 00:05:37.227442 27607 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:05:37.244002 27608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.236875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53870 (local address 127.19.59.125:45521)
0812 00:05:37.237022 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.237024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.237031 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:37.237051 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.237052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.237061 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.237143 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.237723 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.238544 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.239387 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.239622 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.239695 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.241028 (+ 1333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.241030 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.241030 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.241037 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.242817 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.243176 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.243177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.243177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.243253 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.243460 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.243461 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.243462 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.243598 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.243702 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.243793 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.243880 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
WARNING: no policy specified for oryx/127.19.59.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.59.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.59.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.124.keytab.
Entry for principal oryx/127.19.59.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.124.keytab.
I20260812 00:05:37.268733 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.124:42615
--webserver_interface=127.19.59.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.124.keytab
--principal=oryx/127.19.59.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:35137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:33763,127.19.59.125:45521,127.19.59.124:42615
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:37.348541 27612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:37.348851 27612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:37.348891 27612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:37.350076 27612 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:37.350136 27612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:37.350162 27612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:37.350194 27612 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:37.350224 27612 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:37.351732 27612 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:35137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:33763,127.19.59.125:45521,127.19.59.124:42615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.124.keytab
--principal=oryx/127.19.59.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.124:42615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.59.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:37.352011 27612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:37.352236 27612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:37.357169 27618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:37.357292 27612 server_base.cc:1034] running on GCE node
W20260812 00:05:37.357147 27617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:37.357165 27620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:37.357681 27612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:37.358014 27612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:37.359184 27612 hybrid_clock.cc:648] HybridClock initialized: now 1786493137359178 us; error 36 us; skew 500 ppm
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:37.361793 27612 init.cc:377] Logged in from keytab as oryx/127.19.59.124@KRBTEST.COM (short username oryx)
I20260812 00:05:37.362375 27612 webserver.cc:460] Webserver started at http://127.19.59.124:43815/ using document root <none> and password file <none>
I20260812 00:05:37.362609 27612 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:37.362681 27612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:37.362820 27612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:37.363902 27612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/data/instance:
uuid: "8bff3f70b6da4e688ce85cd0703bd45b"
format_stamp: "Formatted at 2026-08-12 00:05:37 on dist-test-slave-6nmv"
server_key: "00782634435380699fa0deb256a306d7"
server_key_iv: "fa9e9d11bc4765b3b387372537f11ad9"
server_key_version: "encryptionkey@0"
I20260812 00:05:37.364202 27612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/wal/instance:
uuid: "8bff3f70b6da4e688ce85cd0703bd45b"
format_stamp: "Formatted at 2026-08-12 00:05:37 on dist-test-slave-6nmv"
server_key: "00782634435380699fa0deb256a306d7"
server_key_iv: "fa9e9d11bc4765b3b387372537f11ad9"
server_key_version: "encryptionkey@0"
I20260812 00:05:37.365542 27612 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:37.366299 27628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.366501 27612 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.366612 27612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/wal
uuid: "8bff3f70b6da4e688ce85cd0703bd45b"
format_stamp: "Formatted at 2026-08-12 00:05:37 on dist-test-slave-6nmv"
server_key: "00782634435380699fa0deb256a306d7"
server_key_iv: "fa9e9d11bc4765b3b387372537f11ad9"
server_key_version: "encryptionkey@0"
I20260812 00:05:37.366698 27612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:37.382189 27612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:37.384347 27612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:37.384526 27612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:37.388972 27612 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.124:42615
I20260812 00:05:37.389022 27685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.124:42615 every 8 connection(s)
I20260812 00:05:37.389387 27612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/data/info.pb
I20260812 00:05:37.390439 27686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:37.392112 27686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:05:37.393401 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 27612
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.124@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.59.124@KRBTEST.COM
I20260812 00:05:37.401976 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.393029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50464 (local address 127.19.59.126:33763)
0812 00:05:37.393079 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.393081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.393133 (+ 52us) server_negotiation.cc:407] Connection header received
0812 00:05:37.393780 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.393781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.393792 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.393897 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.394709 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.395254 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.396146 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.396327 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.396433 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.398781 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.398782 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.398782 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.398788 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.400443 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.400837 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.400838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.400838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.400896 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.401258 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.401259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.401259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.401401 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.401442 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.401757 (+ 315us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.401884 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:05:37.402109 27688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.392804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.0.0.1:50464)
0812 00:05:37.393001 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.393048 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.393644 (+ 596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.393991 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.393996 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.394411 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.394604 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.394609 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.395382 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.395383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.396034 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.396036 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.396461 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.396463 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.396586 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.397161 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.397171 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.398695 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.400520 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.400525 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.400527 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.400761 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.400982 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.400983 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.400983 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.401129 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.401485 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.401491 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.401597 (+ 106us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.401731 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.401897 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":74,"threads_started":1}
I20260812 00:05:37.402734 27689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.393998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46638 (local address 127.19.59.124:42615)
0812 00:05:37.394181 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.394185 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.394205 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:05:37.394235 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.394237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.394264 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.394364 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.394920 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.395678 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.396338 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.396617 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.396692 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.399471 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.399479 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.399479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.399486 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.401187 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.401530 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.401533 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.401533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.401596 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.401824 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.401825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.401825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.401963 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.402567 (+ 604us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.402609 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.402674 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":115,"threads_started":1}
I20260812 00:05:37.402736 27686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.124@KRBTEST.COM for oryx/127.19.59.125@KRBTEST.COM
I20260812 00:05:37.408461 27688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.403025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:45521 (local address 127.0.0.1:53884)
0812 00:05:37.403059 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.403070 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.403114 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.403265 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.403266 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.403436 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.403465 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.403466 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.404063 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.404064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.404558 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.404560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.404869 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.404870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.404907 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.405202 (+ 295us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.405206 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.406351 (+ 1145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.407674 (+ 1323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.407674 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.407675 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.407836 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.408007 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.408008 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.408008 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.408061 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.408255 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.408255 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.408285 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.408340 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.408409 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260812 00:05:37.408478 27608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.403082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53884 (local address 127.19.59.125:45521)
0812 00:05:37.403119 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.403121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.403137 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:05:37.403166 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.403170 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.403182 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.403249 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.403539 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.403994 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.404641 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.404806 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.404848 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.406434 (+ 1586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.406435 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.406435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.406441 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.407602 (+ 1161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.407905 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.407905 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.407906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.407950 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.408124 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.408124 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.408125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.408206 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.408250 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.408355 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.408412 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:05:37.408871 27686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.124@KRBTEST.COM for oryx/127.19.59.124@KRBTEST.COM
I20260812 00:05:37.414383 27688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.409084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:42615 (local address 127.0.0.1:46642)
0812 00:05:37.409130 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.409139 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.409172 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.409283 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.409284 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.409415 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.409441 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.409442 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.410090 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.410091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.410533 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.410534 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.410840 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.410841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.410873 (+ 32us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.411242 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.411247 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.412235 (+ 988us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.413448 (+ 1213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.413449 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.413450 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.413603 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.413878 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.413879 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.413880 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.413944 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.414159 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.414160 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.414192 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.414243 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.414318 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 00:05:37.414436 27689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.409139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46642 (local address 127.19.59.124:42615)
0812 00:05:37.409167 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.409169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.409176 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:37.409233 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.409234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.409241 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.409281 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.409497 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.409995 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.410599 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.410783 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.410825 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.412305 (+ 1480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.412306 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.412306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.412312 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.413376 (+ 1064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.413666 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.413667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.413667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.413713 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.414007 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.414007 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.414007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.414099 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.414151 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.414259 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.414360 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":13}
I20260812 00:05:37.415649 27686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: Bootstrap starting.
I20260812 00:05:37.416455 27686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:37.416673 27686 log.cc:824] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:37.417305 27686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: No bootstrap required, opened a new log
I20260812 00:05:37.418694 27686 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } }
I20260812 00:05:37.418807 27686 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:37.418846 27686 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bff3f70b6da4e688ce85cd0703bd45b, State: Initialized, Role: FOLLOWER
I20260812 00:05:37.418982 27686 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } }
I20260812 00:05:37.419230 27692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } } }
I20260812 00:05:37.419278 27686 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:37.419328 27692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:05:37.420871 27703 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:05:37.420926 27703 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:05:37.423065 27612 master_runner.cc:428] Detected that this master 8bff3f70b6da4e688ce85cd0703bd45b is joining an existing cluster
I20260812 00:05:37.423122 27612 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.59.124:42615
I20260812 00:05:37.430896 27608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.424325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53898 (local address 127.19.59.125:45521)
0812 00:05:37.424385 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.424387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.424512 (+ 125us) server_negotiation.cc:407] Connection header received
0812 00:05:37.424615 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.424615 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.424625 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.424679 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.425042 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.425695 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.426713 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.426978 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.427017 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.428068 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.428070 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.428070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.428077 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.429716 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.430181 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.430182 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.430183 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.430235 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.430425 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.430426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.430427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.430556 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.430611 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.430711 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.430797 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:05:37.430902 27711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.424155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:45521 (local address 127.0.0.1:53898)
0812 00:05:37.424433 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.424443 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.424536 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.424682 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.424683 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.424886 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.424955 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.424956 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.425787 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.425788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.426604 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.426607 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.427086 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.427087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.427144 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.427561 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.427564 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.427976 (+ 412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.429798 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.429799 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.429799 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.430111 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.430303 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.430304 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.430304 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.430359 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.430600 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.430601 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.430637 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.430693 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.430797 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":83,"threads_started":1}
I20260812 00:05:37.434128 27689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.424493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46656 (local address 127.19.59.124:42615)
0812 00:05:37.424546 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.424548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.425094 (+ 546us) server_negotiation.cc:407] Connection header received
0812 00:05:37.425161 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.425162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.425168 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.425189 (+ 21us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.425512 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.426068 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.427408 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.427660 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.427723 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.428534 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.428535 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.428536 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.428542 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.430111 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.430451 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.430451 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.430452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.430489 (+ 37us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.430682 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.430682 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.430683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.430823 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.430862 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.433969 (+ 3107us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.434044 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 00:05:37.434397 27710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.424314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:42615 (local address 127.0.0.1:46656)
0812 00:05:37.425049 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.425057 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.425110 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.425227 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.425228 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.425383 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.425437 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.425438 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.426711 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.426711 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.427329 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.427331 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.427734 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.427735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.427792 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.428171 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.428174 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.428410 (+ 236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.430189 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.430189 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.430190 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.430365 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.430547 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.430548 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.430548 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.430616 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.433773 (+ 3157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.433774 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.433858 (+ 84us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.434201 (+ 343us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.434287 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721,"thread_start_us":78,"threads_started":1}
I20260812 00:05:37.445014 27709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.424103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.0.0.1:50466)
0812 00:05:37.424238 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.424248 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.424325 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.424621 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.424621 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.424808 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.424874 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.424876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.426138 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.426139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.426600 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.426601 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.427063 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.427064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.427117 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.442208 (+ 15091us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.442212 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.442498 (+ 286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.443982 (+ 1484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.443983 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.443983 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.444152 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.444356 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.444357 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.444358 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.444421 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.444701 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.444702 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.444755 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.444825 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.444920 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":1,"thread_start_us":80,"threads_started":1}
I20260812 00:05:37.445019 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.424125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50466 (local address 127.19.59.126:33763)
0812 00:05:37.424173 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.424175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.424298 (+ 123us) server_negotiation.cc:407] Connection header received
0812 00:05:37.424501 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.424502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.424513 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.424545 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.424986 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.425707 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.426680 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.426938 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.427006 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.442584 (+ 15578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.442586 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.442586 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.442593 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.443878 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.444227 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.444228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.444228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.444289 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.444514 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.444515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.444515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.444631 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.444697 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.444860 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.444928 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493136, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.126@KRBTEST.COM for oryx/127.19.59.124@KRBTEST.COM
I20260812 00:05:37.453061 27689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.446999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46660 (local address 127.19.59.124:42615)
0812 00:05:37.447049 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.447051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.447059 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:37.447087 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.447088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.447096 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.447153 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.447357 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.448044 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.448624 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.448887 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.448953 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.450776 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.450777 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.450777 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.450782 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.452020 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.452386 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.452387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.452387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.452432 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.452612 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.452612 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.452612 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.452714 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.452767 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.452945 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.453010 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:05:37.453117 27504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.446837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:42615 (local address 127.0.0.1:46660)
0812 00:05:37.446891 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.446900 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.446942 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.447157 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.447158 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.447266 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.447299 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.447300 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.448112 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.448113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.448553 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.448555 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.448960 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.448961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.449004 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.449356 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.449361 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.450699 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.452099 (+ 1400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.452100 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.452101 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.452312 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.452490 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.452491 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.452491 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.452554 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.452787 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.452788 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.452833 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.452922 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.453019 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 00:05:37.453704 26854 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.59.124:42615: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b"
member_type: NON_VOTER
last_known_addr {
host: "127.19.59.124"
port: 42615
}
attrs {
promote: true
}
}
dest_uuid: "78e8fa15aada475f846835f0c2be6035"
cas_config_opid_index: 5
I20260812 00:05:37.453991 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 26923
I20260812 00:05:37.453959 26854 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: NON_VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: true } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } }
I20260812 00:05:37.457537 27506 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 8bff3f70b6da4e688ce85cd0703bd45b (127.19.59.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: NON_VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: true } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } } }
I20260812 00:05:37.458734 27506 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.59.124:42615
I20260812 00:05:37.458806 27506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: NON_VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: true } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } } }
I20260812 00:05:37.458885 27506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:37.462312 27658 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:37.463428 27658 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 1 FOLLOWER]: Refusing update from remote peer 78e8fa15aada475f846835f0c2be6035: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 00:05:37.463727 27712 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:37.463843 27612 master.cc:537] Master@127.19.59.124:42615 shutting down...
W20260812 00:05:37.464833 26838 consensus_peers.cc:487] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 -> Peer 8bff3f70b6da4e688ce85cd0703bd45b (127.19.59.124:42615): Couldn't send request to peer 8bff3f70b6da4e688ce85cd0703bd45b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 00:05:37.466936 27612 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:37.467022 27612 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:37.467084 27612 tablet_replica.cc:330] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: stopping tablet replica
I20260812 00:05:37.468478 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:32951
--local_ip_for_outbound_sockets=127.19.59.65
--tserver_master_addrs=127.19.59.126:33763
--webserver_port=45557
--webserver_interface=127.19.59.65
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.65.keytab
--principal=oryx/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:35137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.59.126:33763,127.19.59.125:45521
--tserver_master_addrs=127.19.59.126:33763,127.19.59.125:45521,127.19.59.124:42615 with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:05:37.469238 27504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.462121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:45521 (local address 127.0.0.1:53904)
0812 00:05:37.464410 (+ 2289us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.464423 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.464470 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.465306 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.465307 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.465309 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:37.465352 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.465354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.466503 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.466504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.468016 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.468019 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.468937 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.468938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.469023 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.469048 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.469100 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.469145 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2269}
I20260812 00:05:37.469249 27608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.465088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53904 (local address 127.19.59.125:45521)
0812 00:05:37.465155 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.465157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.465167 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:37.465193 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.465194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.465218 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.465283 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:37.465449 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.466181 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.468096 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.468664 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.468800 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.468906 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.469134 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.469183 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 00:05:37.469583 27563 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 1 LEARNER]: Refusing update from remote peer 78e8fa15aada475f846835f0c2be6035: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 00:05:37.469796 27712 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: NON_VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 00:05:37.470371 27563 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 8bff3f70b6da4e688ce85cd0703bd45b (127.19.59.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: NON_VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: true } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } } }
I20260812 00:05:37.471452 27596 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78e8fa15aada475f846835f0c2be6035. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: NON_VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: true } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } } }
I20260812 00:05:37.471540 27596 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: This master's current role is: LEARNER
I20260812 00:05:37.471570 27596 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: NON_VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: true } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } } }
I20260812 00:05:37.471632 27596 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: This master's current role is: LEARNER
I20260812 00:05:37.474408 27505 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035: attempting to promote NON_VOTER b8da70b1a5604714bce6b4bad8d0c23a to VOTER
I20260812 00:05:37.474671 27505 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } }
I20260812 00:05:37.475236 27504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.475108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:42615 (local address 127.0.0.1:46674)
0812 00:05:37.475160 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.475209 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:42615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 00:05:37.475282 27563 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 1 LEARNER]: Refusing update from remote peer 78e8fa15aada475f846835f0c2be6035: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 00:05:37.475450 27506 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 00:05:37.475670 27504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.475552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:42615 (local address 127.0.0.1:46688)
0812 00:05:37.475628 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.475649 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:42615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260812 00:05:37.475778 26838 consensus_peers.cc:487] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 -> Peer 8bff3f70b6da4e688ce85cd0703bd45b (127.19.59.124:42615): Couldn't send request to peer 8bff3f70b6da4e688ce85cd0703bd45b. Status: Network error: Client connection negotiation failed: client connection to 127.19.59.124:42615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 00:05:37.476029 27505 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, b8da70b1a5604714bce6b4bad8d0c23a (127.19.59.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } } }
I20260812 00:05:37.476205 27563 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, b8da70b1a5604714bce6b4bad8d0c23a (127.19.59.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } } }
I20260812 00:05:37.476922 27505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } } }
I20260812 00:05:37.476989 27505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:37.477029 27505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } } }
I20260812 00:05:37.477065 27505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:37.477303 27715 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } } }
I20260812 00:05:37.477409 27715 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:05:37.482405 27612 master.cc:552] Master@127.19.59.124:42615 shutdown complete.
I20260812 00:05:37.482455 27612 master_runner.cc:305] Clearing existing system tablet
I20260812 00:05:37.482576 27612 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:37.482620 27612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:37.483289 27612 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:37.483855 27717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.484007 27612 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:37.484058 27612 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:37.484081 27612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/wal
uuid: "8bff3f70b6da4e688ce85cd0703bd45b"
format_stamp: "Formatted at 2026-08-12 00:05:37 on dist-test-slave-6nmv"
server_key: "00782634435380699fa0deb256a306d7"
server_key_iv: "fa9e9d11bc4765b3b387372537f11ad9"
server_key_version: "encryptionkey@0"
I20260812 00:05:37.484827 27612 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:37.486199 27612 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 00:05:37.486261 27612 log.cc:1196] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 00:05:37.486444 27612 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: Deleting consensus metadata
I20260812 00:05:37.486567 27612 master_runner.cc:315] Copying system tablet from 127.19.59.126:33763
I20260812 00:05:37.487151 27612 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: tablet copy: Beginning tablet copy session from remote peer at address 127.19.59.126:33763
I20260812 00:05:37.494495 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.487487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50472 (local address 127.19.59.126:33763)
0812 00:05:37.487525 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.487527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.487584 (+ 57us) server_negotiation.cc:407] Connection header received
0812 00:05:37.487646 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.487646 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.487656 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.487725 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.488057 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.488815 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.489760 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.490196 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.490282 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.491371 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.491373 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.491373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.491380 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.493184 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.493641 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.493643 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.493643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.493707 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.493960 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.493961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.493961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.494094 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.494165 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.494334 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.494412 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:05:37.494520 27724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.487416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.0.0.1:50472)
0812 00:05:37.487536 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.487545 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.487597 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.487729 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.487729 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.487911 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.487971 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.487973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.488925 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.488926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.489677 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.489679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.490292 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.490293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.490363 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.490899 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.490904 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.491277 (+ 373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.493280 (+ 2003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.493282 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.493282 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.493562 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.493785 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.493785 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.493786 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.493886 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.494169 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.494170 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.494219 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.494295 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.494410 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":73,"threads_started":1}
I20260812 00:05:37.494967 26875 tablet_copy_service.cc:140] P 78e8fa15aada475f846835f0c2be6035: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 8bff3f70b6da4e688ce85cd0703bd45b ({username='oryx', principal='oryx/127.19.59.124@KRBTEST.COM'} at 127.0.0.1:50472)
I20260812 00:05:37.495028 26875 tablet_copy_service.cc:161] P 78e8fa15aada475f846835f0c2be6035: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 8bff3f70b6da4e688ce85cd0703bd45b at {username='oryx', principal='oryx/127.19.59.124@KRBTEST.COM'} at 127.0.0.1:50472: session id = 8bff3f70b6da4e688ce85cd0703bd45b-00000000000000000000000000000000
I20260812 00:05:37.495604 26875 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 00:05:37.496016 27612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 00:05:37.497258 27612 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: tablet copy: Starting download of 0 data blocks...
I20260812 00:05:37.497469 27612 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: tablet copy: Starting download of 1 WAL segments...
I20260812 00:05:37.498383 27612 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 00:05:37.499330 26875 tablet_copy_service.cc:342] P 78e8fa15aada475f846835f0c2be6035: Request end of tablet copy session 8bff3f70b6da4e688ce85cd0703bd45b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.19.59.124@KRBTEST.COM'} at 127.0.0.1:50472
I20260812 00:05:37.499380 26875 tablet_copy_service.cc:433] P 78e8fa15aada475f846835f0c2be6035: ending tablet copy session 8bff3f70b6da4e688ce85cd0703bd45b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 8bff3f70b6da4e688ce85cd0703bd45b
I20260812 00:05:37.502424 27612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:37.503702 27726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:37.503939 27725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:37.503954 27728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:37.510301 27612 server_base.cc:1034] running on GCE node
I20260812 00:05:37.510432 27612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:37.510576 27612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:37.511749 27612 hybrid_clock.cc:648] HybridClock initialized: now 1786493137511726 us; error 39 us; skew 500 ppm
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:37.513362 27612 init.cc:377] Logged in from keytab as oryx/127.19.59.124@KRBTEST.COM (short username oryx)
I20260812 00:05:37.513752 27612 webserver.cc:460] Webserver started at http://127.19.59.124:37729/ using document root <none> and password file <none>
I20260812 00:05:37.513926 27612 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:37.513985 27612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:37.514874 27612 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:37.515544 27736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.515735 27612 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:37.515789 27612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/wal
uuid: "8bff3f70b6da4e688ce85cd0703bd45b"
format_stamp: "Formatted at 2026-08-12 00:05:37 on dist-test-slave-6nmv"
server_key: "00782634435380699fa0deb256a306d7"
server_key_iv: "fa9e9d11bc4765b3b387372537f11ad9"
server_key_version: "encryptionkey@0"
I20260812 00:05:37.515848 27612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:37.524657 27612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:37.526682 27612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:37.529779 27612 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.124:42615
I20260812 00:05:37.530143 27612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/master-2/data/info.pb
I20260812 00:05:37.530366 27799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.124:42615 every 8 connection(s)
I20260812 00:05:37.538439 27800 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:05:37.538981 27800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: Bootstrap starting.
I20260812 00:05:37.542096 27800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:05:37.542320 27800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: Bootstrap complete.
I20260812 00:05:37.542523 27800 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } }
I20260812 00:05:37.542614 27800 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8bff3f70b6da4e688ce85cd0703bd45b, State: Initialized, Role: LEARNER
I20260812 00:05:37.542649 27800 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } }
I20260812 00:05:37.542866 27800 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:37.544400 27814 catalog_manager.cc:1259] Loaded cluster ID: e7ca53663266458c8d1ef8eb5e858a52
I20260812 00:05:37.544503 27814 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: loading cluster ID for follower catalog manager: success
I20260812 00:05:37.545405 27803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } } }
I20260812 00:05:37.545504 27803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [sys.catalog]: This master's current role is: LEARNER
I20260812 00:05:37.545949 27814 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: acquiring CA information for follower catalog manager: success
I20260812 00:05:37.546242 27814 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 00:05:37.568902 27713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:37.569144 27713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:37.569178 27713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:37.570336 27713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:37.570395 27713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:37.570441 27713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:05:37.571939 27713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:35137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.65.keytab
--principal=oryx/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:32951
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=45557
--tserver_master_addrs=127.19.59.126:33763,127.19.59.125:45521,127.19.59.124:42615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:37.572193 27713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:37.572429 27713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:05:37.577554 27713 server_base.cc:1034] running on GCE node
W20260812 00:05:37.577564 27820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:37.577524 27822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:37.577518 27819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:37.577932 27713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:37.578182 27713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:37.579347 27713 hybrid_clock.cc:648] HybridClock initialized: now 1786493137579336 us; error 28 us; skew 500 ppm
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:37.581770 27713 init.cc:377] Logged in from keytab as oryx/127.19.59.65@KRBTEST.COM (short username oryx)
I20260812 00:05:37.582257 27713 webserver.cc:460] Webserver started at http://127.19.59.65:45557/ using document root <none> and password file <none>
I20260812 00:05:37.582440 27713 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:37.582501 27713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:37.583705 27713 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:37.584231 27830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.584414 27713 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:37.584515 27713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "ae39907b6a21452a9ac2e681fac637e0"
format_stamp: "Formatted at 2026-08-12 00:05:36 on dist-test-slave-6nmv"
server_key: "d617faccba78da53a76eda8ddfbcc7fb"
server_key_iv: "f023b5a70cc8f04ddc8bb326591c26c5"
server_key_version: "encryptionkey@0"
I20260812 00:05:37.584841 27713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:37.597968 27713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:37.600090 27713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:37.600263 27713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:37.600455 27713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:37.600734 27713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:37.600765 27713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.600831 27713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:37.600855 27713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.606456 27713 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:32951
I20260812 00:05:37.606545 27962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:32951 every 8 connection(s)
I20260812 00:05:37.606875 27713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.124@KRBTEST.COM
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.125@KRBTEST.COM
I20260812 00:05:37.615113 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 27713
I20260812 00:05:37.615283 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 27090
I20260812 00:05:37.619091 27969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.607849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:42615 (local address 127.19.59.65:37875)
0812 00:05:37.607972 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.607981 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.608346 (+ 365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.608631 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.608631 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.608952 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.609113 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.609119 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.610071 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.610072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.610914 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.610916 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.611368 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.611369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.611494 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.611960 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.611968 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.614148 (+ 2180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.617418 (+ 3270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.617426 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.617428 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.617838 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.618095 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.618096 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.618096 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.618278 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.618622 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.618628 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.618737 (+ 109us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.618824 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.618945 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":55,"thread_start_us":77,"threads_started":1}
I20260812 00:05:37.619141 27970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.608013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:37875 (local address 127.19.59.124:42615)
0812 00:05:37.608116 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.608118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.608126 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:37.608497 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.608498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.608512 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.608604 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.609225 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.609965 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.611010 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.611292 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.611353 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.614257 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.614259 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.614259 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.614266 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.617311 (+ 3045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.617930 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.617931 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.617932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.618004 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.618368 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.618369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.618370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.618546 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.618629 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.618877 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.618987 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79,"thread_start_us":54,"threads_started":1}
I20260812 00:05:37.619632 27963 heartbeater.cc:347] Connected to a master server at 127.19.59.124:42615
I20260812 00:05:37.619753 27963 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:37.619980 27963 heartbeater.cc:511] Master 127.19.59.124:42615 requested a full tablet report, sending...
I20260812 00:05:37.620586 27754 ts_manager.cc:194] Registered new tserver with Master: ae39907b6a21452a9ac2e681fac637e0 (127.19.59.65:32951)
I20260812 00:05:37.625427 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.607558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:35637 (local address 127.19.59.126:33763)
0812 00:05:37.607609 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.607611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.607827 (+ 216us) server_negotiation.cc:407] Connection header received
0812 00:05:37.608511 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.608513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.608525 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.608575 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.609204 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.609982 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.611183 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.611457 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.611527 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.614301 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.614303 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.614304 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.614312 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.616319 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.624239 (+ 7920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.624240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.624241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.624310 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.624570 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.624571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.624571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.624706 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.624760 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.625169 (+ 409us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.625254 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:05:37.625630 27968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.607555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:45521 (local address 127.19.59.65:37409)
0812 00:05:37.607733 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.607752 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.608328 (+ 576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.608589 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.608613 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.609182 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.609242 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.609243 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.610099 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.610100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.611100 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.611102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.611598 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.611599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.611695 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.612304 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.612308 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.614549 (+ 2241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.624558 (+ 10009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.624559 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.624559 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.624761 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.624964 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.624965 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.624965 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.625017 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.625266 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.625268 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.625310 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.625372 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.625464 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":65,"thread_start_us":84,"threads_started":1}
I20260812 00:05:37.625638 27608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.607541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:37409 (local address 127.19.59.125:45521)
0812 00:05:37.607588 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.607591 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.607830 (+ 239us) server_negotiation.cc:407] Connection header received
0812 00:05:37.608444 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.608445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.608475 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.608524 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.609320 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.610020 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.611211 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.611471 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.611530 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.614640 (+ 3110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.614641 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.614642 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.614649 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.624468 (+ 9819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.624834 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.624835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.624835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.624899 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.625078 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.625079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.625080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.625195 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.625262 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.625421 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.625532 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:05:37.625876 27967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.607556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.65:35637)
0812 00:05:37.607709 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.607746 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.608346 (+ 600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.608623 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.608624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.608917 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.609113 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.609117 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.610072 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.610074 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.611100 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.611102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.611528 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.611529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.611624 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.612114 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.612119 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.614199 (+ 2080us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.623910 (+ 9711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.623911 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.623911 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.624141 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.624409 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.624410 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.624410 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.624496 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.624783 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.624784 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.624824 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.624881 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.624987 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":118,"thread_start_us":108,"threads_started":1}
I20260812 00:05:37.626009 27965 heartbeater.cc:347] Connected to a master server at 127.19.59.125:45521
I20260812 00:05:37.626061 27965 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:37.626138 27965 heartbeater.cc:511] Master 127.19.59.125:45521 requested a full tablet report, sending...
I20260812 00:05:37.626475 27553 ts_manager.cc:194] Registered new tserver with Master: ae39907b6a21452a9ac2e681fac637e0 (127.19.59.65:32951)
I20260812 00:05:37.626649 27964 heartbeater.cc:347] Connected to a master server at 127.19.59.126:33763
I20260812 00:05:37.626698 27964 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:37.626751 27964 heartbeater.cc:511] Master 127.19.59.126:33763 requested a full tablet report, sending...
I20260812 00:05:37.627030 26854 ts_manager.cc:194] Re-registered known tserver with Master: ae39907b6a21452a9ac2e681fac637e0 (127.19.59.65:32951)
I20260812 00:05:37.627403 26854 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:35637
I20260812 00:05:37.627432 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:33557
--local_ip_for_outbound_sockets=127.19.59.66
--tserver_master_addrs=127.19.59.126:33763
--webserver_port=34465
--webserver_interface=127.19.59.66
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.66.keytab
--principal=oryx/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:35137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.59.126:33763,127.19.59.125:45521
--tserver_master_addrs=127.19.59.126:33763,127.19.59.125:45521,127.19.59.124:42615 with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:37.709427 27971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:37.709626 27971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:37.709649 27971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:37.710722 27971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:37.710759 27971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:37.710785 27971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:05:37.712224 27971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:35137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.66.keytab
--principal=oryx/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:33557
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=34465
--tserver_master_addrs=127.19.59.126:33763,127.19.59.125:45521,127.19.59.124:42615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:37.712438 27971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:37.712621 27971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:37.717433 27976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:37.717448 27977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:37.717450 27979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:37.717793 27971 server_base.cc:1034] running on GCE node
I20260812 00:05:37.718034 27971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:37.718291 27971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:37.719431 27971 hybrid_clock.cc:648] HybridClock initialized: now 1786493137719414 us; error 36 us; skew 500 ppm
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:37.722033 27971 init.cc:377] Logged in from keytab as oryx/127.19.59.66@KRBTEST.COM (short username oryx)
I20260812 00:05:37.722529 27971 webserver.cc:460] Webserver started at http://127.19.59.66:34465/ using document root <none> and password file <none>
I20260812 00:05:37.722710 27971 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:37.722764 27971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:37.724144 27971 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:37.724728 27987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.724886 27971 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:37.724985 27971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "174dac5782ea46e8b1b4072405f00c1d"
format_stamp: "Formatted at 2026-08-12 00:05:36 on dist-test-slave-6nmv"
server_key: "3b32e1264479adefa642d490aa3efa83"
server_key_iv: "b0ebf10457b300328291fd78aaa83747"
server_key_version: "encryptionkey@0"
I20260812 00:05:37.725330 27971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:37.756990 27971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:37.758894 27971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:37.759018 27971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:37.759193 27971 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:37.759492 27971 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:37.759526 27971 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.759567 27971 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:37.759593 27971 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.765456 27971 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:33557
I20260812 00:05:37.765511 28121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:33557 every 8 connection(s)
I20260812 00:05:37.765868 27971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.125@KRBTEST.COM
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.124@KRBTEST.COM
I20260812 00:05:37.773454 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 27971
I20260812 00:05:37.773615 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 27249
I20260812 00:05:37.778877 27970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.766555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:58509 (local address 127.19.59.124:42615)
0812 00:05:37.766599 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.766602 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.766874 (+ 272us) server_negotiation.cc:407] Connection header received
0812 00:05:37.767473 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.767474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.767489 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.767518 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.768396 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.769121 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.770604 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.770919 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.771001 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.773626 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.773627 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.773627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.773636 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.776977 (+ 3341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.777708 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.777709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.777710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.777776 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.778144 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.778146 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.778146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.778278 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.778323 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.778695 (+ 372us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.778780 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:05:37.778877 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.766932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:57195 (local address 127.19.59.126:33763)
0812 00:05:37.766996 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.766998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.767058 (+ 60us) server_negotiation.cc:407] Connection header received
0812 00:05:37.767478 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.767479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.767492 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.767534 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.768383 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.768881 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.769853 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.770043 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.770116 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.772572 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.772574 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.772574 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.772587 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.777125 (+ 4538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.777708 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.777709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.777710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.777776 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.778145 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.778146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.778146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.778279 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.778323 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.778696 (+ 373us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.778781 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:05:37.779392 28128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.766560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:42615 (local address 127.19.59.66:58509)
0812 00:05:37.766744 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.766786 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.767348 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.767615 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.767616 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.768150 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.768281 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.768287 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.769228 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.769228 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.770078 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.770080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.771003 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.771005 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.771070 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.771452 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.771457 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.773521 (+ 2064us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.777357 (+ 3836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.777357 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.777358 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.777601 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.777897 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.777898 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.777898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.778059 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.778371 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.778378 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.778533 (+ 155us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.779054 (+ 521us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.779232 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":131,"spinlock_wait_cycles":6912,"thread_start_us":94,"threads_started":1}
I20260812 00:05:37.779392 28129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.766841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.66:57195)
0812 00:05:37.766993 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.767004 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.767365 (+ 361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.767880 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.767881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.768091 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.768281 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.768285 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.768990 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.768991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.769732 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.769734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.770124 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.770125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.770247 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.770881 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.770891 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.772465 (+ 1574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.777220 (+ 4755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.777227 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.777229 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.777601 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.777897 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.777898 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.777898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.778059 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.778371 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.778378 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.778533 (+ 155us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.778980 (+ 447us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.779174 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260812 00:05:37.779881 28122 heartbeater.cc:347] Connected to a master server at 127.19.59.124:42615
I20260812 00:05:37.779881 28123 heartbeater.cc:347] Connected to a master server at 127.19.59.126:33763
I20260812 00:05:37.779992 28122 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:37.779992 28123 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:37.780170 28123 heartbeater.cc:511] Master 127.19.59.126:33763 requested a full tablet report, sending...
I20260812 00:05:37.780170 28122 heartbeater.cc:511] Master 127.19.59.124:42615 requested a full tablet report, sending...
I20260812 00:05:37.780679 26854 ts_manager.cc:194] Re-registered known tserver with Master: 174dac5782ea46e8b1b4072405f00c1d (127.19.59.66:33557)
I20260812 00:05:37.780759 27754 ts_manager.cc:194] Registered new tserver with Master: 174dac5782ea46e8b1b4072405f00c1d (127.19.59.66:33557)
I20260812 00:05:37.781095 26854 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:57195
I20260812 00:05:37.785143 27608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.766555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:53413 (local address 127.19.59.125:45521)
0812 00:05:37.766599 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.766602 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.766875 (+ 273us) server_negotiation.cc:407] Connection header received
0812 00:05:37.767470 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.767472 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.767486 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.767518 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.768395 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.769131 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.770180 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.770473 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.770562 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.772997 (+ 2435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.772999 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.772999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.773007 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.783902 (+ 10895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.784290 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.784292 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.784292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.784351 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.784554 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.784555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.784555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.784670 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.784745 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.784890 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.785051 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:05:37.785324 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.766560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:45521 (local address 127.19.59.66:53413)
0812 00:05:37.766744 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.766786 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.767348 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.767602 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.767606 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.768150 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.768282 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.768287 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.769228 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.769228 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.770078 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.770080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.770581 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.770582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.770650 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.771227 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.771232 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.772907 (+ 1675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.783999 (+ 11092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.784000 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.784001 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.784195 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.784425 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.784426 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.784427 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.784487 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.784737 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.784738 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.784779 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.784864 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.785053 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":39,"spinlock_wait_cycles":384,"thread_start_us":89,"threads_started":1}
I20260812 00:05:37.785756 28125 heartbeater.cc:347] Connected to a master server at 127.19.59.125:45521
I20260812 00:05:37.785801 28125 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:37.785921 28125 heartbeater.cc:511] Master 127.19.59.125:45521 requested a full tablet report, sending...
I20260812 00:05:37.786260 27553 ts_manager.cc:194] Registered new tserver with Master: 174dac5782ea46e8b1b4072405f00c1d (127.19.59.66:33557)
I20260812 00:05:37.787323 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:38373
--local_ip_for_outbound_sockets=127.19.59.67
--tserver_master_addrs=127.19.59.126:33763
--webserver_port=34579
--webserver_interface=127.19.59.67
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.67.keytab
--principal=oryx/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:35137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.59.126:33763,127.19.59.125:45521
--tserver_master_addrs=127.19.59.126:33763,127.19.59.125:45521,127.19.59.124:42615 with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:37.870311 28130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:37.870565 28130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:37.870606 28130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:37.871762 28130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:37.871837 28130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:37.871882 28130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:05:37.873385 28130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:35137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.67.keytab
--principal=oryx/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:38373
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=34579
--tserver_master_addrs=127.19.59.126:33763,127.19.59.125:45521,127.19.59.124:42615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:37.873684 28130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:37.873991 28130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:37.879211 28137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:37.879226 28141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:37.879226 28139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:37.879503 28130 server_base.cc:1034] running on GCE node
I20260812 00:05:37.879733 28130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:37.879990 28130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:37.881174 28130 hybrid_clock.cc:648] HybridClock initialized: now 1786493137881151 us; error 41 us; skew 500 ppm
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:37.883882 28130 init.cc:377] Logged in from keytab as oryx/127.19.59.67@KRBTEST.COM (short username oryx)
I20260812 00:05:37.884370 28130 webserver.cc:460] Webserver started at http://127.19.59.67:34579/ using document root <none> and password file <none>
I20260812 00:05:37.884624 28130 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:37.884721 28130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:37.886112 28130 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:37.886706 28150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.886890 28130 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.886988 28130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "8eebdc48423143e1a400d6ea0c47007a"
format_stamp: "Formatted at 2026-08-12 00:05:36 on dist-test-slave-6nmv"
server_key: "423b1eac732d90e398cd0d30cf91d7e2"
server_key_iv: "1176131c32ee785d0a4dfcd46a595ba6"
server_key_version: "encryptionkey@0"
I20260812 00:05:37.887312 28130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:37.903563 28130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:37.906134 28130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:37.906291 28130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:37.906512 28130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:37.906889 28130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:37.906947 28130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.906988 28130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:37.907016 28130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:37.913527 28130 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:38373
I20260812 00:05:37.913584 28284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:38373 every 8 connection(s)
I20260812 00:05:37.914003 28130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:37.919153 27504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.915319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:42615 (local address 127.0.0.1:46698)
0812 00:05:37.915426 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.915437 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.915479 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.915878 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.915880 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.915883 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:37.915940 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.915943 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.917032 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.917033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.918094 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.918097 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.918910 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.918911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.918982 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.918986 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.919016 (+ 30us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.919054 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260812 00:05:37.919575 28293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.915593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46698 (local address 127.19.59.124:42615)
0812 00:05:37.915695 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.915696 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.915704 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:37.915734 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.915735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.915758 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.916008 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:37.916093 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.916924 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.918192 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.918799 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.919346 (+ 547us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.919435 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.919455 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.919495 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":58,"threads_started":1}
I20260812 00:05:37.919854 27767 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 00:05:37.920046 27803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78e8fa15aada475f846835f0c2be6035. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } } }
I20260812 00:05:37.920198 27803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [sys.catalog]: This master's current role is: LEARNER
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
I20260812 00:05:37.922549 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 28130
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.124@KRBTEST.COM
Aug 12 00:05:37 dist-test-slave-6nmv krb5kdc[26808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493137, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.125@KRBTEST.COM
I20260812 00:05:37.926469 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.914790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:33921 (local address 127.19.59.126:33763)
0812 00:05:37.914897 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.914898 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.915446 (+ 548us) server_negotiation.cc:407] Connection header received
0812 00:05:37.915928 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.915929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.915944 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.915975 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.917044 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.917802 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.919476 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.919789 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.919828 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.922622 (+ 2794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.922624 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.922624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.922633 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.924620 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.925275 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.925277 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.925277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.925339 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.925626 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.925628 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.925628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.925781 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.925847 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.926292 (+ 445us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.926368 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:05:37.927040 27970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.915285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:38739 (local address 127.19.59.124:42615)
0812 00:05:37.915343 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.915345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.915649 (+ 304us) server_negotiation.cc:407] Connection header received
0812 00:05:37.916100 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.916101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.916111 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.916138 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.917036 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.917807 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.919484 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.919794 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.919828 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.923865 (+ 4037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.923866 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.923867 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.923875 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.925744 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.926177 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.926178 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.926179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.926251 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.926454 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.926455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.926456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.926581 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.926639 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.926868 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.926946 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:05:37.927332 28291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.914786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:45521 (local address 127.19.59.67:40269)
0812 00:05:37.914999 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.915032 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.915791 (+ 759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.916147 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.916150 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.916658 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.916927 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.916932 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.917917 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.917918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.919298 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.919301 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.920409 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.920410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.920493 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.920898 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.920903 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.923709 (+ 2806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.926208 (+ 2499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.926208 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.926209 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.926411 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.926589 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.926589 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.926590 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.926653 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.926884 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.926885 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.926921 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.926995 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.927148 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":133,"thread_start_us":125,"threads_started":1}
I20260812 00:05:37.927359 28292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.915098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:42615 (local address 127.19.59.67:38739)
0812 00:05:37.915575 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.915583 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.916001 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.916193 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.916194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.916660 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.916927 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.916932 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.917927 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.917928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.919366 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.919369 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.919987 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.919988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.920060 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.920726 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.920730 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.923748 (+ 3018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.925845 (+ 2097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.925846 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.925846 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.926091 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.926322 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.926322 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.926323 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.926376 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.926692 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.926692 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.926744 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.927157 (+ 413us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.927257 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"mutex_wait_us":102,"thread_start_us":69,"threads_started":1}
I20260812 00:05:37.927716 27608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.914787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:40269 (local address 127.19.59.125:45521)
0812 00:05:37.914838 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.914840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.915492 (+ 652us) server_negotiation.cc:407] Connection header received
0812 00:05:37.915921 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.915922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.915936 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.915970 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.917033 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.917710 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.919400 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.919677 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.919723 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.923793 (+ 4070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.923795 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.923795 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.923804 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.926132 (+ 2328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.926481 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.926482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.926483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.926536 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.926706 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.926706 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.926707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.926816 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.926862 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.927576 (+ 714us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.927643 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:05:37.928413 28288 heartbeater.cc:347] Connected to a master server at 127.19.59.125:45521
I20260812 00:05:37.928511 28288 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:37.928582 28285 heartbeater.cc:347] Connected to a master server at 127.19.59.124:42615
I20260812 00:05:37.928613 28285 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:37.928752 28285 heartbeater.cc:511] Master 127.19.59.124:42615 requested a full tablet report, sending...
I20260812 00:05:37.928752 28288 heartbeater.cc:511] Master 127.19.59.125:45521 requested a full tablet report, sending...
I20260812 00:05:37.929191 27553 ts_manager.cc:194] Registered new tserver with Master: 8eebdc48423143e1a400d6ea0c47007a (127.19.59.67:38373)
I20260812 00:05:37.929435 27754 ts_manager.cc:194] Registered new tserver with Master: 8eebdc48423143e1a400d6ea0c47007a (127.19.59.67:38373)
I20260812 00:05:37.930931 28290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.914786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.67:33921)
0812 00:05:37.915376 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.915386 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.915806 (+ 420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.916148 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.916151 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.916656 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:37.916927 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.916932 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.917928 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.917929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.919374 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.919375 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.919928 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.919929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.920060 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.920564 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:37.920572 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:37.922504 (+ 1932us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:37.924722 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.924729 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.924748 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.925175 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.925413 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:37.925413 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:37.925414 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:37.925544 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:37.925932 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:37.925938 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:37.926126 (+ 188us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.930689 (+ 4563us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.930803 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"mutex_wait_us":140,"thread_start_us":111,"threads_started":1}
I20260812 00:05:37.931394 28287 heartbeater.cc:347] Connected to a master server at 127.19.59.126:33763
I20260812 00:05:37.931442 28287 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:37.931505 28287 heartbeater.cc:511] Master 127.19.59.126:33763 requested a full tablet report, sending...
I20260812 00:05:37.931782 26854 ts_manager.cc:194] Re-registered known tserver with Master: 8eebdc48423143e1a400d6ea0c47007a (127.19.59.67:38373)
I20260812 00:05:37.932147 26854 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:33921
I20260812 00:05:37.934285 28293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.924757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46708 (local address 127.19.59.124:42615)
0812 00:05:37.924789 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.924791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.925184 (+ 393us) server_negotiation.cc:407] Connection header received
0812 00:05:37.925274 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.925275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.925284 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.925317 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.926226 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.926851 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.928563 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.928809 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.928844 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.930259 (+ 1415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.930260 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.930261 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.930267 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.932468 (+ 2201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.933380 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.933382 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.933382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.933462 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.933681 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.933682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.933683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.933838 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.933977 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.934087 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.934173 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 00:05:37.935858 27608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.924265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53906 (local address 127.19.59.125:45521)
0812 00:05:37.927805 (+ 3540us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.927806 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.927813 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:37.927829 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.927830 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.927838 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.927883 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.928563 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.929435 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.930478 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.930742 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.930809 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.932274 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.932276 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.932276 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.932284 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.934342 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.934964 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.934966 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.934966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.935036 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.935357 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.935359 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.935359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.935512 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.935612 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.935684 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.935756 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3528,"thread_start_us":76,"threads_started":1}
I20260812 00:05:37.936980 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.923854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50476 (local address 127.19.59.126:33763)
0812 00:05:37.926541 (+ 2687us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.926543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.926549 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:05:37.926566 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.926567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.926575 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.926642 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:37.927418 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.928125 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.931226 (+ 3101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.931546 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.931636 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.934329 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:37.934330 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:37.934331 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:37.934338 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:37.935831 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.936272 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.936273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.936273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.936405 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:37.936563 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:37.936563 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:37.936564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:37.936696 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:37.936778 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.936842 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.936899 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2675,"thread_start_us":98,"threads_started":1}
I20260812 00:05:37.938486 26854 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50476:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:37.940066 26854 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:37.940721 27506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: NON_VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: true } } }
I20260812 00:05:37.940815 27506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:37.942065 27506 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035: attempting to promote NON_VOTER 8bff3f70b6da4e688ce85cd0703bd45b to VOTER
I20260812 00:05:37.942224 27506 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } }
I20260812 00:05:37.942651 27767 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 1 LEARNER]: Refusing update from remote peer 78e8fa15aada475f846835f0c2be6035: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 00:05:37.942821 27563 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 1 FOLLOWER]: Refusing update from remote peer 78e8fa15aada475f846835f0c2be6035: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 00:05:37.942894 28306 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 00:05:37.943006 27506 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 00:05:37.943799 27712 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 8bff3f70b6da4e688ce85cd0703bd45b (127.19.59.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } } }
I20260812 00:05:37.943964 27767 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 8bff3f70b6da4e688ce85cd0703bd45b (127.19.59.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } } }
I20260812 00:05:37.944759 27506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } } }
I20260812 00:05:37.944823 27506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:37.944739 27712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } } }
I20260812 00:05:37.944887 27506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } } }
I20260812 00:05:37.944940 27712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:37.944939 27506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:37.944972 27803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } } }
I20260812 00:05:37.945041 27803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:05:37.944970 27563 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 8bff3f70b6da4e688ce85cd0703bd45b (127.19.59.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } } }
I20260812 00:05:37.946087 27715 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "78e8fa15aada475f846835f0c2be6035" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } } }
I20260812 00:05:37.946182 27715 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:05:37.950470 28315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.946319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37530 (local address 127.19.59.65:32951)
0812 00:05:37.946514 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.946520 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.946531 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:05:37.946571 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.946573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.946589 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.946691 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:37.947004 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.948092 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.949473 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.950102 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.950204 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.950281 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.950352 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.950393 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":84,"threads_started":1}
I20260812 00:05:37.950455 28313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.946105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:32951 (local address 127.0.0.1:37530)
0812 00:05:37.946228 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.946238 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.946281 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.946865 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.946866 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.946868 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:37.946921 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.946923 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.948160 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.948161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.949309 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.949311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.950207 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.950208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.950272 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.950277 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.950337 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.950378 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":77,"threads_started":1}
I20260812 00:05:37.950548 27504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.946034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:33557 (local address 127.0.0.1:48066)
0812 00:05:37.946071 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.946082 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.946124 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.947274 (+ 1150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.947294 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.947296 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:37.947333 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.947334 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.948450 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.948451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.949502 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.949504 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.950353 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.950354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.950410 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.950413 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.950441 (+ 28us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.950471 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260812 00:05:37.950948 28316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.946373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48066 (local address 127.19.59.66:33557)
0812 00:05:37.946684 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.946689 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.946698 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:37.946735 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.946737 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.946752 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.947275 (+ 523us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:37.947416 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.948377 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.949565 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.950273 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.950701 (+ 428us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.950778 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.950803 (+ 25us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.950843 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":75,"threads_started":1}
I20260812 00:05:37.951375 28314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.946113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:38373 (local address 127.0.0.1:38980)
0812 00:05:37.946524 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.946534 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:37.946585 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:37.948183 (+ 1598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:37.948184 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:37.948186 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:37.948229 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.948231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.949102 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.949103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.950132 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:37.950135 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.951175 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.951176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:37.951231 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.951234 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:37.951276 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 00:05:37.951308 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":81,"threads_started":1}
I20260812 00:05:37.951495 27883 tablet_service.cc:1467] Processing CreateTablet for tablet b32d3e71876c470a9a7e1f39da51dd77 (DEFAULT_TABLE table=test-table [id=4c5b13afa9a0411391072059064f6335]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:37.951691 28317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.946524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38980 (local address 127.19.59.67:38373)
0812 00:05:37.947055 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:37.947059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:37.947067 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:37.947097 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:37.947098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:37.947112 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:37.947180 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:37.948294 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.949027 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.950220 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:37.950886 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:37.950947 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:37.951524 (+ 577us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:37.951552 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 00:05:37.951592 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":63,"threads_started":1}
I20260812 00:05:37.951530 28045 tablet_service.cc:1467] Processing CreateTablet for tablet b32d3e71876c470a9a7e1f39da51dd77 (DEFAULT_TABLE table=test-table [id=4c5b13afa9a0411391072059064f6335]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:37.951920 27883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b32d3e71876c470a9a7e1f39da51dd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:37.951943 28045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b32d3e71876c470a9a7e1f39da51dd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:37.952207 28206 tablet_service.cc:1467] Processing CreateTablet for tablet b32d3e71876c470a9a7e1f39da51dd77 (DEFAULT_TABLE table=test-table [id=4c5b13afa9a0411391072059064f6335]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:37.952520 28206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b32d3e71876c470a9a7e1f39da51dd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:37.955044 28318 tablet_bootstrap.cc:492] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d: Bootstrap starting.
I20260812 00:05:37.955516 28319 tablet_bootstrap.cc:492] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0: Bootstrap starting.
I20260812 00:05:37.956027 28318 tablet_bootstrap.cc:654] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:37.956013 28320 tablet_bootstrap.cc:492] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a: Bootstrap starting.
I20260812 00:05:37.956247 28319 tablet_bootstrap.cc:654] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:37.956477 28318 log.cc:824] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:37.956605 28320 tablet_bootstrap.cc:654] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:37.956607 28319 log.cc:824] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:37.956954 28320 log.cc:824] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:37.957329 28318 tablet_bootstrap.cc:492] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d: No bootstrap required, opened a new log
I20260812 00:05:37.957403 28319 tablet_bootstrap.cc:492] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0: No bootstrap required, opened a new log
I20260812 00:05:37.957422 28318 ts_tablet_manager.cc:1397] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:37.957469 28319 ts_tablet_manager.cc:1397] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:37.957722 28320 tablet_bootstrap.cc:492] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a: No bootstrap required, opened a new log
I20260812 00:05:37.957791 28320 ts_tablet_manager.cc:1397] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:37.959345 28319 raft_consensus.cc:348] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } } peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } }
I20260812 00:05:37.959502 28319 raft_consensus.cc:374] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:37.959542 28319 raft_consensus.cc:729] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae39907b6a21452a9ac2e681fac637e0, State: Initialized, Role: FOLLOWER
I20260812 00:05:37.959651 28319 consensus_queue.cc:260] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } } peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } }
I20260812 00:05:37.959985 27964 heartbeater.cc:503] Master 127.19.59.126:33763 was elected leader, sending a full tablet report...
I20260812 00:05:37.960201 28319 ts_tablet_manager.cc:1428] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:05:37.960135 28318 raft_consensus.cc:348] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } } peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } }
I20260812 00:05:37.960297 28318 raft_consensus.cc:374] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:37.960340 28318 raft_consensus.cc:729] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 174dac5782ea46e8b1b4072405f00c1d, State: Initialized, Role: FOLLOWER
I20260812 00:05:37.960472 28318 consensus_queue.cc:260] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } } peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } }
I20260812 00:05:37.960716 28318 ts_tablet_manager.cc:1428] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 00:05:37.960855 28123 heartbeater.cc:503] Master 127.19.59.126:33763 was elected leader, sending a full tablet report...
I20260812 00:05:37.962039 28320 raft_consensus.cc:348] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } } peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } }
I20260812 00:05:37.962193 28320 raft_consensus.cc:374] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:37.962241 28320 raft_consensus.cc:729] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eebdc48423143e1a400d6ea0c47007a, State: Initialized, Role: FOLLOWER
I20260812 00:05:37.962355 28320 consensus_queue.cc:260] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } } peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } }
I20260812 00:05:37.962673 28287 heartbeater.cc:503] Master 127.19.59.126:33763 was elected leader, sending a full tablet report...
I20260812 00:05:37.962611 28320 ts_tablet_manager.cc:1428] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
W20260812 00:05:38.017416 28126 tablet.cc:2369] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:05:38.067355 28325 raft_consensus.cc:482] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:38.067538 28325 raft_consensus.cc:504] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } } peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } }
I20260812 00:05:38.067966 28325 leader_election.cc:288] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 174dac5782ea46e8b1b4072405f00c1d (127.19.59.66:33557), 8eebdc48423143e1a400d6ea0c47007a (127.19.59.67:38373)
I20260812 00:05:38.071070 27967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:38.068164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:33557 (local address 127.19.59.65:34357)
0812 00:05:38.068228 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:38.068241 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:38.068315 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:38.068513 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:38.068514 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:38.068515 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:38.068596 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:38.068598 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.069412 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.069413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:38.070167 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:38.070169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.070840 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.070841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:38.070912 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:38.070915 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:38.070967 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 00:05:38.070996 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":20}
I20260812 00:05:38.071134 28316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:38.068277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:34357 (local address 127.19.59.66:33557)
0812 00:05:38.068351 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:38.068354 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:38.068391 (+ 37us) server_negotiation.cc:407] Connection header received
0812 00:05:38.068425 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:38.068426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:38.068438 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:38.068496 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:38.068682 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.069256 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.070259 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.070755 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.070823 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:38.070855 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:38.070999 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 00:05:38.071052 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:05:38.071215 27968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:38.068289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:38373 (local address 127.19.59.65:32941)
0812 00:05:38.068382 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:38.068393 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:38.068437 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:38.068618 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:38.068619 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:38.068621 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:38.068730 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:38.068732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.069344 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.069345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:38.070319 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:38.070322 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.070891 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.070892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:38.071007 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:38.071011 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:38.071079 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 00:05:38.071117 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":31}
I20260812 00:05:38.071225 28317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:38.068425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:32941 (local address 127.19.59.67:38373)
0812 00:05:38.068490 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:38.068492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:38.068500 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:38.068524 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:38.068525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:38.068534 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:38.068593 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:38.068819 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.069239 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.070429 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.070773 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.070864 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:38.070872 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:38.071101 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 00:05:38.071145 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 00:05:38.071591 28067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b32d3e71876c470a9a7e1f39da51dd77" candidate_uuid: "ae39907b6a21452a9ac2e681fac637e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "174dac5782ea46e8b1b4072405f00c1d" is_pre_election: true
I20260812 00:05:38.071627 28231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b32d3e71876c470a9a7e1f39da51dd77" candidate_uuid: "ae39907b6a21452a9ac2e681fac637e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eebdc48423143e1a400d6ea0c47007a" is_pre_election: true
I20260812 00:05:38.071791 28067 raft_consensus.cc:2454] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae39907b6a21452a9ac2e681fac637e0 in term 0.
I20260812 00:05:38.071815 28231 raft_consensus.cc:2454] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae39907b6a21452a9ac2e681fac637e0 in term 0.
I20260812 00:05:38.072062 27831 leader_election.cc:302] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 174dac5782ea46e8b1b4072405f00c1d, ae39907b6a21452a9ac2e681fac637e0; no voters:
I20260812 00:05:38.072207 28325 raft_consensus.cc:2781] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:38.072285 28325 raft_consensus.cc:482] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:38.072321 28325 raft_consensus.cc:3037] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:38.073031 28325 raft_consensus.cc:504] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } } peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } }
I20260812 00:05:38.073164 28325 leader_election.cc:288] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [CANDIDATE]: Term 1 election: Requested vote from peers 174dac5782ea46e8b1b4072405f00c1d (127.19.59.66:33557), 8eebdc48423143e1a400d6ea0c47007a (127.19.59.67:38373)
I20260812 00:05:38.073346 28067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b32d3e71876c470a9a7e1f39da51dd77" candidate_uuid: "ae39907b6a21452a9ac2e681fac637e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "174dac5782ea46e8b1b4072405f00c1d"
I20260812 00:05:38.073437 28067 raft_consensus.cc:3037] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:38.073423 28231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b32d3e71876c470a9a7e1f39da51dd77" candidate_uuid: "ae39907b6a21452a9ac2e681fac637e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eebdc48423143e1a400d6ea0c47007a"
I20260812 00:05:38.073521 28231 raft_consensus.cc:3037] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:38.074242 28067 raft_consensus.cc:2454] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae39907b6a21452a9ac2e681fac637e0 in term 1.
I20260812 00:05:38.074471 27831 leader_election.cc:302] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 174dac5782ea46e8b1b4072405f00c1d, ae39907b6a21452a9ac2e681fac637e0; no voters:
I20260812 00:05:38.074585 28231 raft_consensus.cc:2454] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae39907b6a21452a9ac2e681fac637e0 in term 1.
I20260812 00:05:38.074613 28325 raft_consensus.cc:2781] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:38.074836 28325 raft_consensus.cc:686] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [term 1 LEADER]: Becoming Leader. State: Replica: ae39907b6a21452a9ac2e681fac637e0, State: Running, Role: LEADER
I20260812 00:05:38.074977 28325 consensus_queue.cc:237] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } } peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } }
I20260812 00:05:38.075994 26853 catalog_manager.cc:5495] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae39907b6a21452a9ac2e681fac637e0 (127.19.59.65). New cstate: current_term: 1 leader_uuid: "ae39907b6a21452a9ac2e681fac637e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } health_report { overall_health: HEALTHY } } }
I20260812 00:05:38.095315 28315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:38.093238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37544 (local address 127.19.59.65:32951)
0812 00:05:38.093300 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:38.093302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:38.093308 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:05:38.093339 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:38.093340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:38.093373 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:38.093441 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:38.093554 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.094071 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.094750 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.094916 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.094982 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:38.095091 (+ 109us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:38.095174 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:38.095227 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:38.095254 (+ 27us) server_negotiation.cc:299] Negotiation successful
0812 00:05:38.095268 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:05:38.096908 28231 raft_consensus.cc:1261] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a [term 1 FOLLOWER]: Refusing update from remote peer ae39907b6a21452a9ac2e681fac637e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:38.096923 28067 raft_consensus.cc:1261] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d [term 1 FOLLOWER]: Refusing update from remote peer ae39907b6a21452a9ac2e681fac637e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:38.097306 28325 consensus_queue.cc:1035] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:38.097468 28330 consensus_queue.cc:1035] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:38.101605 28334 mvcc.cc:205] Tried to move back new op lower bound from 7317475893642416128 to 7317475893555851264. Current Snapshot: MvccSnapshot[applied={T|T < 7317475893642416128}]
I20260812 00:05:38.103297 26854 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50476:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:38.103415 26854 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50476:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:38.104842 26854 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 78e8fa15aada475f846835f0c2be6035: Sending DeleteTablet for 3 replicas of tablet b32d3e71876c470a9a7e1f39da51dd77
I20260812 00:05:38.105223 28045 tablet_service.cc:1514] Processing DeleteTablet for tablet b32d3e71876c470a9a7e1f39da51dd77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:38 UTC) from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:48066
I20260812 00:05:38.105443 28344 tablet_replica.cc:330] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d: stopping tablet replica
I20260812 00:05:38.105432 28206 tablet_service.cc:1514] Processing DeleteTablet for tablet b32d3e71876c470a9a7e1f39da51dd77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:38 UTC) from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:38980
I20260812 00:05:38.105578 28344 raft_consensus.cc:2229] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:38.105659 28346 tablet_replica.cc:330] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a: stopping tablet replica
I20260812 00:05:38.105747 28344 raft_consensus.cc:2258] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:38.105785 28346 raft_consensus.cc:2229] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:38.106068 28346 raft_consensus.cc:2258] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:38.106357 28344 ts_tablet_manager.cc:1905] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:38.106555 28346 ts_tablet_manager.cc:1905] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:38.106782 27883 tablet_service.cc:1514] Processing DeleteTablet for tablet b32d3e71876c470a9a7e1f39da51dd77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:38 UTC) from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:37530
I20260812 00:05:38.107369 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 26821
I20260812 00:05:38.109416 28344 ts_tablet_manager.cc:1918] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:38.109561 28344 log.cc:1196] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/b32d3e71876c470a9a7e1f39da51dd77
I20260812 00:05:38.109998 28344 ts_tablet_manager.cc:1939] T b32d3e71876c470a9a7e1f39da51dd77 P 174dac5782ea46e8b1b4072405f00c1d: Deleting consensus metadata
I20260812 00:05:38.112874 28346 ts_tablet_manager.cc:1918] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:38.112955 28346 log.cc:1196] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/b32d3e71876c470a9a7e1f39da51dd77
I20260812 00:05:38.113197 28346 ts_tablet_manager.cc:1939] T b32d3e71876c470a9a7e1f39da51dd77 P 8eebdc48423143e1a400d6ea0c47007a: Deleting consensus metadata
I20260812 00:05:38.114132 28349 tablet_replica.cc:330] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0: stopping tablet replica
I20260812 00:05:38.114233 28349 raft_consensus.cc:2229] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:38.114332 28349 raft_consensus.cc:2258] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:38.114755 28349 ts_tablet_manager.cc:1905] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:38.116369 28349 ts_tablet_manager.cc:1918] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:38.116446 28349 log.cc:1196] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-0/wal/wals/b32d3e71876c470a9a7e1f39da51dd77
I20260812 00:05:38.116719 28349 ts_tablet_manager.cc:1939] T b32d3e71876c470a9a7e1f39da51dd77 P ae39907b6a21452a9ac2e681fac637e0: Deleting consensus metadata
W20260812 00:05:38.117676 28151 connection.cc:535] server connection from 127.0.0.1:38980 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 00:05:38.117694 27832 connection.cc:535] server connection from 127.0.0.1:37530 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 00:05:38.118013 27990 connection.cc:535] server connection from 127.0.0.1:48066 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:05:38.122967 28293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:38.106569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46716 (local address 127.19.59.124:42615)
0812 00:05:38.106618 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:38.106620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:38.114011 (+ 7391us) server_negotiation.cc:407] Connection header received
0812 00:05:38.114079 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:38.114080 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:38.114092 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:38.114138 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:38.115235 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.116047 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.117309 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.117602 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.117671 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:38.119937 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:38.119938 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:38.119939 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:38.119967 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:38.121762 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:38.122167 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:38.122168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:38.122169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:38.122246 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:38.122417 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:38.122417 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:38.122418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:38.122517 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:38.122593 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:38.122775 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 00:05:38.122854 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:05:38.126940 27970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:38.119630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46726 (local address 127.19.59.124:42615)
0812 00:05:38.119667 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:38.119669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:38.119833 (+ 164us) server_negotiation.cc:407] Connection header received
0812 00:05:38.119959 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:38.119960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:38.119970 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:38.119997 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:38.120776 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.121444 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.122507 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.122817 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.122854 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:38.124336 (+ 1482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:38.124337 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:38.124338 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:38.124345 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:38.125775 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:38.126169 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:38.126170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:38.126171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:38.126230 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:38.126473 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:38.126473 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:38.126474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:38.126587 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:38.126687 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:38.126776 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 00:05:38.126840 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:05:38.127916 27608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:38.119763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53918 (local address 127.19.59.125:45521)
0812 00:05:38.119811 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:38.119813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:38.120003 (+ 190us) server_negotiation.cc:407] Connection header received
0812 00:05:38.120124 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:38.120126 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:38.120136 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:38.120162 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:38.120848 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.121584 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.122620 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:38.122907 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:38.122945 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:38.124749 (+ 1804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:38.124751 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:38.124751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:38.124759 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:38.126741 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:38.127204 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:38.127205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:38.127205 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:38.127260 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:38.127433 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:38.127434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:38.127434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:38.127532 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:38.127599 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:38.127719 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 00:05:38.127804 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:05:39.101656 28357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.101329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.67:33707)
0812 00:05:39.101501 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.101598 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":97,"threads_started":1}
W20260812 00:05:39.101948 28287 heartbeater.cc:644] Failed to heartbeat to 127.19.59.126:33763 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
I20260812 00:05:39.102288 28358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.102048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.65:47273)
0812 00:05:39.102175 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.102227 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":54,"threads_started":1}
W20260812 00:05:39.102522 27964 heartbeater.cc:644] Failed to heartbeat to 127.19.59.126:33763 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
I20260812 00:05:39.102924 28359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.102681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.66:56567)
0812 00:05:39.102821 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.102889 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":69,"threads_started":1}
W20260812 00:05:39.103096 28123 heartbeater.cc:644] Failed to heartbeat to 127.19.59.126:33763 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
I20260812 00:05:39.605091 28360 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 78e8fa15aada475f846835f0c2be6035)
I20260812 00:05:39.605250 28360 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } }
I20260812 00:05:39.605566 28360 leader_election.cc:288] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 78e8fa15aada475f846835f0c2be6035 (127.19.59.126:33763), b8da70b1a5604714bce6b4bad8d0c23a (127.19.59.125:45521)
I20260812 00:05:39.606235 28361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.605794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.0.0.1:50972)
0812 00:05:39.605954 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.606188 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":109,"threads_started":1}
I20260812 00:05:39.606384 28364 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 78e8fa15aada475f846835f0c2be6035)
W20260812 00:05:39.606426 27737 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
I20260812 00:05:39.606599 28364 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } }
I20260812 00:05:39.606837 28364 leader_election.cc:288] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 78e8fa15aada475f846835f0c2be6035 (127.19.59.126:33763), 8bff3f70b6da4e688ce85cd0703bd45b (127.19.59.124:42615)
I20260812 00:05:39.607015 28361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.606850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.0.0.1:50996)
0812 00:05:39.606941 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.606991 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260812 00:05:39.607131 27737 leader_election.cc:334] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 78e8fa15aada475f846835f0c2be6035 (127.19.59.126:33763): Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
I20260812 00:05:39.607357 28369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.606967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.0.0.1:51008)
0812 00:05:39.607252 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.607311 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":65,"threads_started":1}
W20260812 00:05:39.607518 27533 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
I20260812 00:05:39.608033 28369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.607911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.0.0.1:51016)
0812 00:05:39.607954 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.607984 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 00:05:39.608114 27533 leader_election.cc:334] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 78e8fa15aada475f846835f0c2be6035 (127.19.59.126:33763): Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
I20260812 00:05:39.609484 28362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.605842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:45521 (local address 127.0.0.1:53922)
0812 00:05:39.606132 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.606145 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:39.606219 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:39.606608 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:39.606610 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:39.606612 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:39.606682 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:39.606685 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.607731 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.607732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:39.608699 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:39.608702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.609256 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.609257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:39.609317 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:39.609321 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:39.609381 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:05:39.609420 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":44,"threads_started":1}
I20260812 00:05:39.609519 28363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.605910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53922 (local address 127.19.59.125:45521)
0812 00:05:39.606389 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:39.606392 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:39.606403 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:05:39.606430 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:39.606430 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:39.606444 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:39.606767 (+ 323us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:39.606814 (+ 47us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.607583 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.608783 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.609164 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.609228 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:39.609239 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:39.609424 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 00:05:39.609465 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":74,"threads_started":1}
I20260812 00:05:39.609889 27563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" is_pre_election: true
I20260812 00:05:39.610013 27563 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bff3f70b6da4e688ce85cd0703bd45b in term 1.
I20260812 00:05:39.610160 27739 leader_election.cc:302] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bff3f70b6da4e688ce85cd0703bd45b, b8da70b1a5604714bce6b4bad8d0c23a; no voters: 78e8fa15aada475f846835f0c2be6035
I20260812 00:05:39.610258 28360 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 00:05:39.610301 28360 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 78e8fa15aada475f846835f0c2be6035)
I20260812 00:05:39.610321 28360 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:05:39.611006 28360 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } }
I20260812 00:05:39.611143 28360 leader_election.cc:288] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [CANDIDATE]: Term 2 election: Requested vote from peers 78e8fa15aada475f846835f0c2be6035 (127.19.59.126:33763), b8da70b1a5604714bce6b4bad8d0c23a (127.19.59.125:45521)
I20260812 00:05:39.611285 27563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b8da70b1a5604714bce6b4bad8d0c23a"
I20260812 00:05:39.611325 28362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.611237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.0.0.1:51032)
0812 00:05:39.611274 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.611298 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 00:05:39.611382 27563 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:05:39.611596 28368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.607125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:42615 (local address 127.0.0.1:46732)
0812 00:05:39.607328 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.607337 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:39.607393 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:39.607917 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:39.607918 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:39.607920 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:39.607960 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:39.607961 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.608616 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.608617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:39.609565 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:39.609568 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.611244 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.611245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:39.611305 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:39.611308 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:39.611457 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 00:05:39.611504 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":44,"threads_started":1}
I20260812 00:05:39.611635 28370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.607310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46732 (local address 127.19.59.124:42615)
0812 00:05:39.607748 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:39.607749 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:39.607759 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:39.607788 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:39.607789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:39.607797 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:39.607906 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:39.608040 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.608535 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.609649 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.610197 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.611241 (+ 1044us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:39.611253 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:39.611521 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 00:05:39.611571 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
I20260812 00:05:39.612059 27767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" is_pre_election: true
I20260812 00:05:39.612175 27767 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8da70b1a5604714bce6b4bad8d0c23a in current term 2: Already voted for candidate 8bff3f70b6da4e688ce85cd0703bd45b in this term.
I20260812 00:05:39.612283 28362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.611567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.0.0.1:51044)
0812 00:05:39.611620 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.612256 (+ 636us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260812 00:05:39.612336 27737 leader_election.cc:334] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 78e8fa15aada475f846835f0c2be6035 (127.19.59.126:33763): Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
I20260812 00:05:39.612340 27563 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bff3f70b6da4e688ce85cd0703bd45b in term 2.
I20260812 00:05:39.612349 27533 leader_election.cc:302] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8da70b1a5604714bce6b4bad8d0c23a; no voters: 78e8fa15aada475f846835f0c2be6035, 8bff3f70b6da4e688ce85cd0703bd45b
I20260812 00:05:39.612459 28364 raft_consensus.cc:2726] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:05:39.612557 27739 leader_election.cc:302] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bff3f70b6da4e688ce85cd0703bd45b, b8da70b1a5604714bce6b4bad8d0c23a; no voters: 78e8fa15aada475f846835f0c2be6035
I20260812 00:05:39.612659 28360 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:05:39.612807 28360 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [term 2 LEADER]: Becoming Leader. State: Replica: 8bff3f70b6da4e688ce85cd0703bd45b, State: Running, Role: LEADER
I20260812 00:05:39.612876 28360 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } }
I20260812 00:05:39.613257 28372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8bff3f70b6da4e688ce85cd0703bd45b. Latest consensus state: current_term: 2 leader_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } } }
I20260812 00:05:39.613353 28372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:39.613554 28374 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:39.613981 28374 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:39.614060 28374 catalog_manager.cc:1259] Loaded cluster ID: e7ca53663266458c8d1ef8eb5e858a52
I20260812 00:05:39.614096 28374 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:39.614264 28374 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:39.614362 28374 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: Loaded TSK: 0
I20260812 00:05:39.614506 28374 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:05:39.671080 27754 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46726:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:39.672770 27754 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:39.673919 28362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.673759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.0.0.1:51064)
0812 00:05:39.673844 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.673885 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 00:05:39.673938 27563 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [term 2 FOLLOWER]: Refusing update from remote peer 8bff3f70b6da4e688ce85cd0703bd45b: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260812 00:05:39.674234 28372 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 00:05:39.674368 28362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.674260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.0.0.1:51066)
0812 00:05:39.674313 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.674345 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 00:05:39.674440 27737 consensus_peers.cc:487] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b -> Peer 78e8fa15aada475f846835f0c2be6035 (127.19.59.126:33763): Couldn't send request to peer 78e8fa15aada475f846835f0c2be6035. Status: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 00:05:39.674997 28364 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8bff3f70b6da4e688ce85cd0703bd45b. Latest consensus state: current_term: 2 leader_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } } }
I20260812 00:05:39.675114 28364 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:05:39.675441 28375 mvcc.cc:205] Tried to move back new op lower bound from 7317475900102127616 to 7317475899855073280. Current Snapshot: MvccSnapshot[applied={T|T < 7317475900102127616}]
I20260812 00:05:39.675527 28360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } } }
I20260812 00:05:39.675621 28360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:39.675791 28364 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "78e8fa15aada475f846835f0c2be6035" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 33763 } } peers { permanent_uuid: "b8da70b1a5604714bce6b4bad8d0c23a" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 45521 } attrs { promote: false } } peers { permanent_uuid: "8bff3f70b6da4e688ce85cd0703bd45b" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 42615 } attrs { promote: false } } }
I20260812 00:05:39.675887 28364 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8da70b1a5604714bce6b4bad8d0c23a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:05:39.681270 28362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.677802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:38373 (local address 127.0.0.1:38990)
0812 00:05:39.678030 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.678039 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:39.678080 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:39.678319 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:39.678320 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:39.678322 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:39.678367 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:39.678368 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.679334 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.679335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:39.680420 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:39.680422 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.681014 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.681015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:39.681086 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:39.681091 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:05:39.681147 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 00:05:39.681192 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":28,"thread_start_us":113,"threads_started":1}
I20260812 00:05:39.681270 28386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.678044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38990 (local address 127.19.59.67:38373)
0812 00:05:39.678176 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:39.678178 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:39.678187 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:39.678213 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:39.678213 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:39.678224 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:39.678438 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:39.678474 (+ 36us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.679233 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.680516 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.680889 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.681012 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:39.681040 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:39.681157 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 00:05:39.681195 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
I20260812 00:05:39.681365 28383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.677803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48078 (local address 127.19.59.66:33557)
0812 00:05:39.677984 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:39.677986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:39.677997 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:05:39.678160 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:39.678161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:39.678175 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:39.678403 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:39.678446 (+ 43us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.678995 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.680323 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.680926 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.681235 (+ 309us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:39.681249 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:39.681266 (+ 17us) server_negotiation.cc:299] Negotiation successful
0812 00:05:39.681297 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":53,"threads_started":1}
I20260812 00:05:39.681665 28361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.677710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:33557 (local address 127.0.0.1:48078)
0812 00:05:39.677774 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.677784 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:39.677854 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:39.678267 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:39.678269 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:39.678272 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:39.678336 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:39.678339 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.679085 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.679087 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:39.680227 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:39.680229 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.681019 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.681020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:39.681085 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:39.681089 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:39.681117 (+ 28us) client_negotiation.cc:240] Negotiation successful
0812 00:05:39.681159 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":24}
I20260812 00:05:39.681736 28206 tablet_service.cc:1467] Processing CreateTablet for tablet 2af05d0a554b4feab6046ba55d09597a (DEFAULT_TABLE table=test-table [id=d39fa1f2d78045389e315d8ed4a77195]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:39.681912 28206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2af05d0a554b4feab6046ba55d09597a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:39.681957 28045 tablet_service.cc:1467] Processing CreateTablet for tablet 2af05d0a554b4feab6046ba55d09597a (DEFAULT_TABLE table=test-table [id=d39fa1f2d78045389e315d8ed4a77195]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:39.682076 28045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2af05d0a554b4feab6046ba55d09597a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:39.682485 28385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.677709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:32951 (local address 127.0.0.1:37560)
0812 00:05:39.678149 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.678159 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:39.678240 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:39.678452 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:39.678452 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:39.678454 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:39.678486 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:39.678487 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.679360 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.679360 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:39.681430 (+ 2070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:39.681433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.682226 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.682228 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:39.682290 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:39.682294 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:39.682381 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 00:05:39.682425 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":20}
I20260812 00:05:39.682521 28384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.677803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37560 (local address 127.19.59.65:32951)
0812 00:05:39.677984 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:39.677987 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:39.678212 (+ 225us) server_negotiation.cc:407] Connection header received
0812 00:05:39.678316 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:39.678317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:39.678328 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:39.678370 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:39.678564 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.679278 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.681543 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.682155 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.682226 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:39.682240 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:39.682391 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 00:05:39.682445 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":95,"threads_started":1}
I20260812 00:05:39.683050 27883 tablet_service.cc:1467] Processing CreateTablet for tablet 2af05d0a554b4feab6046ba55d09597a (DEFAULT_TABLE table=test-table [id=d39fa1f2d78045389e315d8ed4a77195]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:39.683204 27883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2af05d0a554b4feab6046ba55d09597a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:39.683857 28389 tablet_bootstrap.cc:492] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d: Bootstrap starting.
I20260812 00:05:39.684240 28389 tablet_bootstrap.cc:654] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:39.684545 28390 tablet_bootstrap.cc:492] T 2af05d0a554b4feab6046ba55d09597a P ae39907b6a21452a9ac2e681fac637e0: Bootstrap starting.
I20260812 00:05:39.684561 28387 tablet_bootstrap.cc:492] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a: Bootstrap starting.
I20260812 00:05:39.684923 28387 tablet_bootstrap.cc:654] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:39.684937 28390 tablet_bootstrap.cc:654] T 2af05d0a554b4feab6046ba55d09597a P ae39907b6a21452a9ac2e681fac637e0: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:39.685501 28390 tablet_bootstrap.cc:492] T 2af05d0a554b4feab6046ba55d09597a P ae39907b6a21452a9ac2e681fac637e0: No bootstrap required, opened a new log
I20260812 00:05:39.685528 28387 tablet_bootstrap.cc:492] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a: No bootstrap required, opened a new log
I20260812 00:05:39.685565 28387 ts_tablet_manager.cc:1397] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:39.685568 28390 ts_tablet_manager.cc:1397] T 2af05d0a554b4feab6046ba55d09597a P ae39907b6a21452a9ac2e681fac637e0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:39.685657 28387 raft_consensus.cc:348] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } } peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } }
I20260812 00:05:39.685712 28387 raft_consensus.cc:374] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:39.685726 28387 raft_consensus.cc:729] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eebdc48423143e1a400d6ea0c47007a, State: Initialized, Role: FOLLOWER
I20260812 00:05:39.685683 28390 raft_consensus.cc:348] T 2af05d0a554b4feab6046ba55d09597a P ae39907b6a21452a9ac2e681fac637e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } } peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } }
I20260812 00:05:39.685772 28390 raft_consensus.cc:374] T 2af05d0a554b4feab6046ba55d09597a P ae39907b6a21452a9ac2e681fac637e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:39.685793 28390 raft_consensus.cc:729] T 2af05d0a554b4feab6046ba55d09597a P ae39907b6a21452a9ac2e681fac637e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae39907b6a21452a9ac2e681fac637e0, State: Initialized, Role: FOLLOWER
I20260812 00:05:39.685788 28387 consensus_queue.cc:260] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } } peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } }
I20260812 00:05:39.685868 28390 consensus_queue.cc:260] T 2af05d0a554b4feab6046ba55d09597a P ae39907b6a21452a9ac2e681fac637e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } } peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } }
I20260812 00:05:39.685987 28387 ts_tablet_manager.cc:1428] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:39.686021 28390 ts_tablet_manager.cc:1428] T 2af05d0a554b4feab6046ba55d09597a P ae39907b6a21452a9ac2e681fac637e0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:39.686604 28399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.686259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.65:41077)
0812 00:05:39.686400 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.686443 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":91,"threads_started":1}
I20260812 00:05:39.686928 28285 heartbeater.cc:503] Master 127.19.59.124:42615 was elected leader, sending a full tablet report...
I20260812 00:05:39.687075 28397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.686149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.67:59073)
0812 00:05:39.686991 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.687043 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":820,"thread_start_us":84,"threads_started":1}
I20260812 00:05:39.687114 28389 tablet_bootstrap.cc:492] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d: No bootstrap required, opened a new log
I20260812 00:05:39.687161 28389 ts_tablet_manager.cc:1397] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 00:05:39.687193 27963 heartbeater.cc:503] Master 127.19.59.124:42615 was elected leader, sending a full tablet report...
I20260812 00:05:39.687330 28389 raft_consensus.cc:348] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } } peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } }
I20260812 00:05:39.687423 28389 raft_consensus.cc:374] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:39.687444 28389 raft_consensus.cc:729] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 174dac5782ea46e8b1b4072405f00c1d, State: Initialized, Role: FOLLOWER
I20260812 00:05:39.687490 28389 consensus_queue.cc:260] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } } peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } }
I20260812 00:05:39.687666 28389 ts_tablet_manager.cc:1428] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:39.687989 28401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.687782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.66:42989)
0812 00:05:39.687907 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.687949 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":68,"threads_started":1}
I20260812 00:05:39.688272 28122 heartbeater.cc:503] Master 127.19.59.124:42615 was elected leader, sending a full tablet report...
I20260812 00:05:39.688333 28401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.688193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.66:39903)
0812 00:05:39.688228 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.688258 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260812 00:05:39.688376 28397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.688280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.67:60747)
0812 00:05:39.688318 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.688348 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260812 00:05:39.688485 28399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.688390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.65:41449)
0812 00:05:39.688427 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.688457 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260812 00:05:39.862274 27966 tablet.cc:2369] T 2af05d0a554b4feab6046ba55d09597a P ae39907b6a21452a9ac2e681fac637e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:05:39.878016 28394 raft_consensus.cc:482] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:39.878141 28394 raft_consensus.cc:504] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } } peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } }
I20260812 00:05:39.878506 28394 leader_election.cc:288] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae39907b6a21452a9ac2e681fac637e0 (127.19.59.65:32951), 174dac5782ea46e8b1b4072405f00c1d (127.19.59.66:33557)
I20260812 00:05:39.881428 28402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.878692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:32951 (local address 127.19.59.67:44861)
0812 00:05:39.878911 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.878922 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:39.878982 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:39.879130 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:39.879131 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:39.879149 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:39.879223 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:39.879225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.879838 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.879839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:39.880614 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:39.880616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.881142 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.881143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:39.881207 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:39.881211 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:39.881252 (+ 41us) client_negotiation.cc:240] Negotiation successful
0812 00:05:39.881281 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":44,"thread_start_us":118,"threads_started":1}
I20260812 00:05:39.881422 28384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.878778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:44861 (local address 127.19.59.65:32951)
0812 00:05:39.878836 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:39.878838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:39.879022 (+ 184us) server_negotiation.cc:407] Connection header received
0812 00:05:39.879052 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:39.879052 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:39.879064 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:39.879115 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:39.879297 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.879756 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.880712 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.881057 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.881111 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:39.881118 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:39.881285 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 00:05:39.881336 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:05:39.881520 28397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.878692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:33557 (local address 127.19.59.67:45425)
0812 00:05:39.878754 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.878766 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:39.878822 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:39.879007 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:39.879008 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:39.879011 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:39.879101 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:39.879102 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.879767 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.879768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:39.880616 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:39.880618 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.881184 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.881185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:39.881276 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:39.881279 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:39.881336 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 00:05:39.881391 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":56}
I20260812 00:05:39.881678 28383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.878778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:45425 (local address 127.19.59.66:33557)
0812 00:05:39.878829 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:39.878831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:39.878844 (+ 13us) server_negotiation.cc:407] Connection header received
0812 00:05:39.878878 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:39.878879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:39.878889 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:39.878980 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:39.879175 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.879690 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.880714 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.881066 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.881155 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:39.881164 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:39.881358 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 00:05:39.881421 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:05:39.881769 27906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2af05d0a554b4feab6046ba55d09597a" candidate_uuid: "8eebdc48423143e1a400d6ea0c47007a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae39907b6a21452a9ac2e681fac637e0" is_pre_election: true
I20260812 00:05:39.881961 27906 raft_consensus.cc:2454] T 2af05d0a554b4feab6046ba55d09597a P ae39907b6a21452a9ac2e681fac637e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8eebdc48423143e1a400d6ea0c47007a in term 0.
I20260812 00:05:39.881983 28067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2af05d0a554b4feab6046ba55d09597a" candidate_uuid: "8eebdc48423143e1a400d6ea0c47007a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "174dac5782ea46e8b1b4072405f00c1d" is_pre_election: true
I20260812 00:05:39.882112 28067 raft_consensus.cc:2454] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8eebdc48423143e1a400d6ea0c47007a in term 0.
I20260812 00:05:39.882166 28154 leader_election.cc:302] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eebdc48423143e1a400d6ea0c47007a, ae39907b6a21452a9ac2e681fac637e0; no voters:
I20260812 00:05:39.882292 28394 raft_consensus.cc:2781] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:39.882352 28394 raft_consensus.cc:482] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:39.882372 28394 raft_consensus.cc:3037] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:39.883061 28394 raft_consensus.cc:504] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } } peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } }
I20260812 00:05:39.883195 28394 leader_election.cc:288] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [CANDIDATE]: Term 1 election: Requested vote from peers ae39907b6a21452a9ac2e681fac637e0 (127.19.59.65:32951), 174dac5782ea46e8b1b4072405f00c1d (127.19.59.66:33557)
I20260812 00:05:39.883332 27906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2af05d0a554b4feab6046ba55d09597a" candidate_uuid: "8eebdc48423143e1a400d6ea0c47007a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae39907b6a21452a9ac2e681fac637e0"
I20260812 00:05:39.883337 28067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2af05d0a554b4feab6046ba55d09597a" candidate_uuid: "8eebdc48423143e1a400d6ea0c47007a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "174dac5782ea46e8b1b4072405f00c1d"
I20260812 00:05:39.883409 27906 raft_consensus.cc:3037] T 2af05d0a554b4feab6046ba55d09597a P ae39907b6a21452a9ac2e681fac637e0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:39.883414 28067 raft_consensus.cc:3037] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:39.884054 28067 raft_consensus.cc:2454] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eebdc48423143e1a400d6ea0c47007a in term 1.
I20260812 00:05:39.884158 27906 raft_consensus.cc:2454] T 2af05d0a554b4feab6046ba55d09597a P ae39907b6a21452a9ac2e681fac637e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eebdc48423143e1a400d6ea0c47007a in term 1.
I20260812 00:05:39.884212 28151 leader_election.cc:302] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 174dac5782ea46e8b1b4072405f00c1d, 8eebdc48423143e1a400d6ea0c47007a; no voters:
I20260812 00:05:39.884297 28394 raft_consensus.cc:2781] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:39.884445 28394 raft_consensus.cc:686] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [term 1 LEADER]: Becoming Leader. State: Replica: 8eebdc48423143e1a400d6ea0c47007a, State: Running, Role: LEADER
I20260812 00:05:39.884533 28394 consensus_queue.cc:237] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } } peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } }
I20260812 00:05:39.884913 28397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.884803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.67:42319)
0812 00:05:39.884848 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.884886 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260812 00:05:39.885250 27753 catalog_manager.cc:5495] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8eebdc48423143e1a400d6ea0c47007a (127.19.59.67). New cstate: current_term: 1 leader_uuid: "8eebdc48423143e1a400d6ea0c47007a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eebdc48423143e1a400d6ea0c47007a" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38373 } health_report { overall_health: HEALTHY } } }
I20260812 00:05:39.907675 28386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.905636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38992 (local address 127.19.59.67:38373)
0812 00:05:39.905699 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:39.905701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:39.905710 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:39.905738 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:39.905738 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:39.905753 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:39.905860 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:39.905987 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.906395 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.907069 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:39.907237 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:39.907284 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:39.907408 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:39.907516 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:39.907570 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:39.907607 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 00:05:39.907623 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:05:39.908700 28067 raft_consensus.cc:1261] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d [term 1 FOLLOWER]: Refusing update from remote peer 8eebdc48423143e1a400d6ea0c47007a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:39.908746 27906 raft_consensus.cc:1261] T 2af05d0a554b4feab6046ba55d09597a P ae39907b6a21452a9ac2e681fac637e0 [term 1 FOLLOWER]: Refusing update from remote peer 8eebdc48423143e1a400d6ea0c47007a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:39.908962 28403 consensus_queue.cc:1035] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [LEADER]: Connected to new peer: Peer: permanent_uuid: "174dac5782ea46e8b1b4072405f00c1d" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:39.909071 28394 consensus_queue.cc:1035] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae39907b6a21452a9ac2e681fac637e0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 32951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:39.909629 28401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.909545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.66:44959)
0812 00:05:39.909578 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.909603 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260812 00:05:39.910005 28399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.909864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.65:47743)
0812 00:05:39.909935 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.909978 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 00:05:39.910955 28406 mvcc.cc:205] Tried to move back new op lower bound from 7317475901063970816 to 7317475900967514112. Current Snapshot: MvccSnapshot[applied={T|T < 7317475901063970816}]
I20260812 00:05:39.911343 28397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.911263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.67:53875)
0812 00:05:39.911297 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.911319 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260812 00:05:39.911401 28401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.911321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.66:58189)
0812 00:05:39.911353 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.911374 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260812 00:05:39.911880 28407 mvcc.cc:205] Tried to move back new op lower bound from 7317475901063970816 to 7317475900967514112. Current Snapshot: MvccSnapshot[applied={T|T < 7317475901063970816 or (T in {7317475901063970816})}]
I20260812 00:05:39.912005 28399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.911799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:33763 (local address 127.19.59.65:35707)
0812 00:05:39.911938 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.911978 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
I20260812 00:05:39.915370 27753 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:39.915469 27753 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:39.916742 27753 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8bff3f70b6da4e688ce85cd0703bd45b: Sending DeleteTablet for 3 replicas of tablet 2af05d0a554b4feab6046ba55d09597a
I20260812 00:05:39.917053 28045 tablet_service.cc:1514] Processing DeleteTablet for tablet 2af05d0a554b4feab6046ba55d09597a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:39 UTC) from {username='oryx', principal='oryx/127.19.59.124@KRBTEST.COM'} at 127.0.0.1:48078
I20260812 00:05:39.917160 28206 tablet_service.cc:1514] Processing DeleteTablet for tablet 2af05d0a554b4feab6046ba55d09597a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:39 UTC) from {username='oryx', principal='oryx/127.19.59.124@KRBTEST.COM'} at 127.0.0.1:38990
I20260812 00:05:39.917295 28418 tablet_replica.cc:330] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d: stopping tablet replica
I20260812 00:05:39.917384 28418 raft_consensus.cc:2229] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:39.917477 28418 raft_consensus.cc:2258] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:39.917479 28419 tablet_replica.cc:330] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a: stopping tablet replica
I20260812 00:05:39.917526 28419 raft_consensus.cc:2229] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:39.917596 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 27713
I20260812 00:05:39.917619 28419 raft_consensus.cc:2258] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:39.917888 28419 ts_tablet_manager.cc:1905] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:39.919425 28419 ts_tablet_manager.cc:1918] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:39.919481 28419 log.cc:1196] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/2af05d0a554b4feab6046ba55d09597a
I20260812 00:05:39.919697 28419 ts_tablet_manager.cc:1939] T 2af05d0a554b4feab6046ba55d09597a P 8eebdc48423143e1a400d6ea0c47007a: Deleting consensus metadata
I20260812 00:05:39.919993 27737 catalog_manager.cc:4841] TS 8eebdc48423143e1a400d6ea0c47007a (127.19.59.67:38373): tablet 2af05d0a554b4feab6046ba55d09597a (table test-table [id=d39fa1f2d78045389e315d8ed4a77195]) successfully deleted
I20260812 00:05:39.924470 28418 ts_tablet_manager.cc:1905] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:39.925983 28418 ts_tablet_manager.cc:1918] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:39.926043 28418 log.cc:1196] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/2af05d0a554b4feab6046ba55d09597a
I20260812 00:05:39.926242 28418 ts_tablet_manager.cc:1939] T 2af05d0a554b4feab6046ba55d09597a P 174dac5782ea46e8b1b4072405f00c1d: Deleting consensus metadata
I20260812 00:05:39.926668 27737 catalog_manager.cc:4841] TS 174dac5782ea46e8b1b4072405f00c1d (127.19.59.66:33557): tablet 2af05d0a554b4feab6046ba55d09597a (table test-table [id=d39fa1f2d78045389e315d8ed4a77195]) successfully deleted
W20260812 00:05:39.928050 27739 connection.cc:535] client connection to 127.19.59.65:32951 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:05:39.928460 28385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.928327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:32951 (local address 127.0.0.1:37564)
0812 00:05:39.928382 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.928432 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:32951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 00:05:39.928562 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 27971
W20260812 00:05:39.928612 27739 catalog_manager.cc:4584] TS ae39907b6a21452a9ac2e681fac637e0 (127.19.59.65:32951): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2af05d0a554b4feab6046ba55d09597a: Network error: Client connection negotiation failed: client connection to 127.19.59.65:32951: connect: Connection refused (error 111)
I20260812 00:05:39.935000 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 28130
I20260812 00:05:39.940552 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 27399
I20260812 00:05:39.946587 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 27612
2026-08-12T00:05:39Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (4840 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:40 dist-test-slave-6nmv krb5kdc[28425](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:40 dist-test-slave-6nmv krb5kdc[28425](info): set up 2 sockets
Aug 12 00:05:40 dist-test-slave-6nmv krb5kdc[28425](info): commencing operation
krb5kdc: starting...
W20260812 00:05:41.036487 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:05:41 dist-test-slave-6nmv krb5kdc[28425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:41Z Disabled control of system clock
WARNING: no policy specified for oryx/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.126.keytab.
Entry for principal oryx/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.126.keytab.
I20260812 00:05:41.152252 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:43367
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.126.keytab
--principal=oryx/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:46421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:43367
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:41.228353 28441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:41.228543 28441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:41.228562 28441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:41.229584 28441 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:41.229621 28441 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 00:05:41.229633 28441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:41.229683 28441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:41.229724 28441 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:41.229745 28441 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:41.231166 28441 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:46421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:43367
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.126.keytab
--principal=oryx/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:43367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:41.231385 28441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:41.231622 28441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:41.236344 28447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:41.236431 28450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:41.236472 28441 server_base.cc:1034] running on GCE node
W20260812 00:05:41.236366 28448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:41.236737 28441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:41.236999 28441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:41.238133 28441 hybrid_clock.cc:648] HybridClock initialized: now 1786493141238119 us; error 26 us; skew 500 ppm
Aug 12 00:05:41 dist-test-slave-6nmv krb5kdc[28425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493141, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:41.240576 28441 init.cc:377] Logged in from keytab as oryx/127.19.59.126@KRBTEST.COM (short username oryx)
I20260812 00:05:41.241014 28441 webserver.cc:460] Webserver started at http://127.19.59.126:45309/ using document root <none> and password file <none>
I20260812 00:05:41.241261 28441 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:41.241325 28441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:41.241456 28441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:41.242484 28441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "8aed2b178a9f4a118b7e3ed3de02784d"
format_stamp: "Formatted at 2026-08-12 00:05:41 on dist-test-slave-6nmv"
server_key: "82f9a4afb2445d705bcf04eb9ae1666d"
server_key_iv: "e797c063ea0b26936d88321e5a65cf2c"
server_key_version: "encryptionkey@0"
I20260812 00:05:41.242818 28441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "8aed2b178a9f4a118b7e3ed3de02784d"
format_stamp: "Formatted at 2026-08-12 00:05:41 on dist-test-slave-6nmv"
server_key: "82f9a4afb2445d705bcf04eb9ae1666d"
server_key_iv: "e797c063ea0b26936d88321e5a65cf2c"
server_key_version: "encryptionkey@0"
I20260812 00:05:41.244150 28441 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:41.244920 28457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:41.245095 28441 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:41.245187 28441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "8aed2b178a9f4a118b7e3ed3de02784d"
format_stamp: "Formatted at 2026-08-12 00:05:41 on dist-test-slave-6nmv"
server_key: "82f9a4afb2445d705bcf04eb9ae1666d"
server_key_iv: "e797c063ea0b26936d88321e5a65cf2c"
server_key_version: "encryptionkey@0"
I20260812 00:05:41.245268 28441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:41.258692 28441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:41.260550 28441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:41.260700 28441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:41.265285 28441 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:43367
I20260812 00:05:41.265372 28524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:43367 every 8 connection(s)
I20260812 00:05:41.265673 28441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:41.266429 28527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:41.266667 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 28441
I20260812 00:05:41.266774 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:41.266976 19693 external_mini_cluster.cc:1428] Setting key a8d38e85986e775a71e52ec1b0cb4c47
I20260812 00:05:41.269465 28527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d: Bootstrap starting.
I20260812 00:05:41.270191 28527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:41.270526 28527 log.cc:824] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:41.271306 28527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d: No bootstrap required, opened a new log
I20260812 00:05:41.273674 28527 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aed2b178a9f4a118b7e3ed3de02784d" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43367 } }
I20260812 00:05:41.273870 28527 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:41.273908 28527 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aed2b178a9f4a118b7e3ed3de02784d, State: Initialized, Role: FOLLOWER
Aug 12 00:05:41 dist-test-slave-6nmv krb5kdc[28425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
I20260812 00:05:41.274035 28527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aed2b178a9f4a118b7e3ed3de02784d" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43367 } }
I20260812 00:05:41.274118 28527 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:41.274142 28527 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:41.274211 28527 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:41.274935 28527 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aed2b178a9f4a118b7e3ed3de02784d" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43367 } }
I20260812 00:05:41.275069 28527 leader_election.cc:302] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8aed2b178a9f4a118b7e3ed3de02784d; no voters:
I20260812 00:05:41.275246 28527 leader_election.cc:288] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:41.275306 28533 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:41.275457 28533 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [term 1 LEADER]: Becoming Leader. State: Replica: 8aed2b178a9f4a118b7e3ed3de02784d, State: Running, Role: LEADER
I20260812 00:05:41.275513 28527 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:41.275547 28533 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aed2b178a9f4a118b7e3ed3de02784d" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43367 } }
I20260812 00:05:41.276135 28536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8aed2b178a9f4a118b7e3ed3de02784d. Latest consensus state: current_term: 1 leader_uuid: "8aed2b178a9f4a118b7e3ed3de02784d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aed2b178a9f4a118b7e3ed3de02784d" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43367 } } }
I20260812 00:05:41.276225 28536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:41.276664 28543 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:41.277122 28535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8aed2b178a9f4a118b7e3ed3de02784d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aed2b178a9f4a118b7e3ed3de02784d" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43367 } } }
I20260812 00:05:41.277201 28543 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:41.277213 28535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:41.278375 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.267506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45352 (local address 127.19.59.126:43367)
0812 00:05:41.267694 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.267704 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.267737 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:05:41.268251 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.268259 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.268316 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.268470 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:41.269016 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.270388 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.271203 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.271802 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.271917 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.274512 (+ 2595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:41.274516 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:41.274517 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:41.274530 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:41.276703 (+ 2173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.277171 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.277174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.277174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.277280 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.277504 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.277505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.277505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.277771 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:41.277944 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.278055 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.278183 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":78,"threads_started":1}
I20260812 00:05:41.279002 28543 catalog_manager.cc:1347] Generated new cluster ID: 54b81e9aaa074cef97644396d75fa5cd
I20260812 00:05:41.279049 28543 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:41.292969 28543 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:41.293643 28543 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:41.300757 28543 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d: Generated new TSK 0
I20260812 00:05:41.300917 28543 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.65.keytab.
Entry for principal oryx/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.65.keytab.
I20260812 00:05:41.326140 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:43367
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.65.keytab
--principal=oryx/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:46421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:41.403026 28558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:41.403245 28558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:41.403268 28558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:41.404417 28558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:41.404465 28558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:41.404486 28558 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:05:41.404539 28558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:05:41.405995 28558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:46421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.65.keytab
--principal=oryx/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.59.126:43367
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:41.406231 28558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:41.406481 28558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:41.411281 28565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:41.411293 28566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:41.411293 28568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:41.411473 28558 server_base.cc:1034] running on GCE node
I20260812 00:05:41.411744 28558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:41.411978 28558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:41.413161 28558 hybrid_clock.cc:648] HybridClock initialized: now 1786493141413134 us; error 56 us; skew 500 ppm
Aug 12 00:05:41 dist-test-slave-6nmv krb5kdc[28425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493141, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:41.415915 28558 init.cc:377] Logged in from keytab as oryx/127.19.59.65@KRBTEST.COM (short username oryx)
I20260812 00:05:41.416379 28558 webserver.cc:460] Webserver started at http://127.19.59.65:39657/ using document root <none> and password file <none>
I20260812 00:05:41.416631 28558 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:41.416702 28558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:41.416869 28558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:41.417930 28558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "6322906eb3c04fdcb1efa0f80b56135b"
format_stamp: "Formatted at 2026-08-12 00:05:41 on dist-test-slave-6nmv"
server_key: "b2d41003caa540f4ecf5dd64c3ceb63f"
server_key_iv: "1e37d4661c291a4d06b82d89f98db5cf"
server_key_version: "encryptionkey@0"
I20260812 00:05:41.418284 28558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "6322906eb3c04fdcb1efa0f80b56135b"
format_stamp: "Formatted at 2026-08-12 00:05:41 on dist-test-slave-6nmv"
server_key: "b2d41003caa540f4ecf5dd64c3ceb63f"
server_key_iv: "1e37d4661c291a4d06b82d89f98db5cf"
server_key_version: "encryptionkey@0"
I20260812 00:05:41.419541 28558 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:41.420282 28577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:41.420457 28558 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:41.420557 28558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "6322906eb3c04fdcb1efa0f80b56135b"
format_stamp: "Formatted at 2026-08-12 00:05:41 on dist-test-slave-6nmv"
server_key: "b2d41003caa540f4ecf5dd64c3ceb63f"
server_key_iv: "1e37d4661c291a4d06b82d89f98db5cf"
server_key_version: "encryptionkey@0"
I20260812 00:05:41.420641 28558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:41.433991 28558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:41.436412 28558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:41.436576 28558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:41.437230 28558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:41.437295 28558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:41.437325 28558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:41.437392 28558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:05:41 dist-test-slave-6nmv krb5kdc[28425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493141, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
I20260812 00:05:41.445436 28558 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:43929
I20260812 00:05:41.445508 28707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:43929 every 8 connection(s)
I20260812 00:05:41.445880 28558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:05:41.447024 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.437631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:48501 (local address 127.19.59.126:43367)
0812 00:05:41.437706 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.437709 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.437899 (+ 190us) server_negotiation.cc:407] Connection header received
0812 00:05:41.438370 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.438372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.438387 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.438498 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:41.439198 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.439712 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.440678 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.440981 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.441066 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.443485 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:41.443487 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:41.443487 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:41.443495 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:41.445468 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.446040 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.446042 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.446042 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.446118 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.446432 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.446433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.446433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.446545 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:41.446599 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.446873 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.446962 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 00:05:41.447091 28586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.437613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:43367 (local address 127.19.59.65:48501)
0812 00:05:41.437756 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:41.437793 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:41.438276 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:41.438584 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:41.438593 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:41.438893 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:41.439096 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.439102 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.439804 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.439805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.440592 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.440595 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.441077 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.441078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.441197 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.441673 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:41.441680 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:41.443393 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:41.445572 (+ 2179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:41.445577 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:41.445579 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:41.445938 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:41.446205 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:41.446206 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:41.446206 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:41.446341 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:41.446608 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:41.446612 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:41.446716 (+ 104us) client_negotiation.cc:769] Sending connection context
0812 00:05:41.446797 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 00:05:41.446941 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":84,"threads_started":1}
I20260812 00:05:41.447641 28708 heartbeater.cc:347] Connected to a master server at 127.19.59.126:43367
I20260812 00:05:41.447728 28708 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:41.447907 28708 heartbeater.cc:511] Master 127.19.59.126:43367 requested a full tablet report, sending...
I20260812 00:05:41.448846 28476 ts_manager.cc:194] Registered new tserver with Master: 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65:43929)
I20260812 00:05:41.449510 28476 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:48501
I20260812 00:05:41.450320 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 28558
I20260812 00:05:41.450444 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:41.450656 19693 external_mini_cluster.cc:1428] Setting key 98fe3a29e08f6adec6dff74ee9e49c15
I20260812 00:05:41.455243 28719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.448670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:43367 (local address 127.19.59.65:34351)
0812 00:05:41.448858 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:41.448867 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:41.448993 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:41.449109 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:41.449110 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:41.449275 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:41.449324 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.449325 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.450168 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.450169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.450993 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.450995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.451424 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.451425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.451503 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.451930 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:41.451935 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:41.452384 (+ 449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:41.454282 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:41.454283 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:41.454283 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:41.454464 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:41.454680 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:41.454681 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:41.454681 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:41.454741 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:41.455026 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:41.455027 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:41.455062 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 00:05:41.455113 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:05:41.455185 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":90,"threads_started":1}
I20260812 00:05:41.455348 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.448739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:34351 (local address 127.19.59.126:43367)
0812 00:05:41.448794 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.448796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.448951 (+ 155us) server_negotiation.cc:407] Connection header received
0812 00:05:41.449043 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.449044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.449054 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.449098 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:41.449407 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.450051 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.451076 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.451340 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.451407 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.452474 (+ 1067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:41.452475 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:41.452475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:41.452481 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:41.454181 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.454541 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.454542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.454543 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.454606 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.454807 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.454808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.454808 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.454966 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:41.455029 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.455154 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.455234 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
WARNING: no policy specified for oryx/127.19.59.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.66.keytab.
Entry for principal oryx/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.66.keytab.
I20260812 00:05:41.474805 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:43367
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.66.keytab
--principal=oryx/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:46421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:41.551337 28722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:41.551520 28722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:41.551542 28722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:41.552670 28722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:41.552711 28722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:41.552731 28722 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:05:41.552791 28722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:05:41.554241 28722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:46421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.66.keytab
--principal=oryx/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.59.126:43367
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:41.554472 28722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:41.554705 28722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:05:41.559506 28722 server_base.cc:1034] running on GCE node
W20260812 00:05:41.559449 28729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:41.559453 28731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:41.559477 28728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:41.559911 28722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:41.560144 28722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:41.561308 28722 hybrid_clock.cc:648] HybridClock initialized: now 1786493141561297 us; error 23 us; skew 500 ppm
Aug 12 00:05:41 dist-test-slave-6nmv krb5kdc[28425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493141, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:41.564409 28722 init.cc:377] Logged in from keytab as oryx/127.19.59.66@KRBTEST.COM (short username oryx)
I20260812 00:05:41.564864 28722 webserver.cc:460] Webserver started at http://127.19.59.66:44217/ using document root <none> and password file <none>
I20260812 00:05:41.565140 28722 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:41.565203 28722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:41.565346 28722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:41.566442 28722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "f57eace3355b4bb39ca07ea722340afe"
format_stamp: "Formatted at 2026-08-12 00:05:41 on dist-test-slave-6nmv"
server_key: "82902e29d505a438dac6daeca40e763a"
server_key_iv: "1635eb073b2a3aa2ac5e184a0351d36a"
server_key_version: "encryptionkey@0"
I20260812 00:05:41.566792 28722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "f57eace3355b4bb39ca07ea722340afe"
format_stamp: "Formatted at 2026-08-12 00:05:41 on dist-test-slave-6nmv"
server_key: "82902e29d505a438dac6daeca40e763a"
server_key_iv: "1635eb073b2a3aa2ac5e184a0351d36a"
server_key_version: "encryptionkey@0"
I20260812 00:05:41.568375 28722 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:41.569105 28739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:41.569273 28722 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:41.569365 28722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "f57eace3355b4bb39ca07ea722340afe"
format_stamp: "Formatted at 2026-08-12 00:05:41 on dist-test-slave-6nmv"
server_key: "82902e29d505a438dac6daeca40e763a"
server_key_iv: "1635eb073b2a3aa2ac5e184a0351d36a"
server_key_version: "encryptionkey@0"
I20260812 00:05:41.569443 28722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:41.583856 28722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:41.585736 28722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:41.585923 28722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:41.586460 28722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:41.586529 28722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:41.586568 28722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:41.586616 28722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:05:41 dist-test-slave-6nmv krb5kdc[28425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493141, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
I20260812 00:05:41.594008 28722 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:40917
I20260812 00:05:41.594085 28870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:40917 every 8 connection(s)
I20260812 00:05:41.594430 28722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:41.596787 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.586957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:56635 (local address 127.19.59.126:43367)
0812 00:05:41.587034 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.587037 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.587224 (+ 187us) server_negotiation.cc:407] Connection header received
0812 00:05:41.587694 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.587696 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.587710 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.587802 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:41.588696 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.589565 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.590767 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.590983 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.591073 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.594096 (+ 3023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:41.594097 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:41.594098 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:41.594106 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:41.595600 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.596034 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.596035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.596036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.596094 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.596291 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.596292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.596292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.596398 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:41.596445 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.596654 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.596723 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 00:05:41.596997 28750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.586940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:43367 (local address 127.19.59.66:56635)
0812 00:05:41.587094 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:41.587134 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:41.587603 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:41.587849 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:41.587852 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:41.588290 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:41.588583 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.588590 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.589698 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.589699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.590637 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.590640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.591099 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.591101 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.591242 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.591761 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:41.591770 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:41.593978 (+ 2208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:41.595693 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:41.595700 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:41.595701 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:41.595956 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:41.596143 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:41.596143 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:41.596143 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:41.596234 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:41.596441 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:41.596443 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:41.596549 (+ 106us) client_negotiation.cc:769] Sending connection context
0812 00:05:41.596625 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 00:05:41.596743 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260812 00:05:41.597527 28871 heartbeater.cc:347] Connected to a master server at 127.19.59.126:43367
I20260812 00:05:41.597612 28871 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:41.597805 28871 heartbeater.cc:511] Master 127.19.59.126:43367 requested a full tablet report, sending...
I20260812 00:05:41.598292 28475 ts_manager.cc:194] Registered new tserver with Master: f57eace3355b4bb39ca07ea722340afe (127.19.59.66:40917)
I20260812 00:05:41.598773 28475 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:56635
I20260812 00:05:41.599146 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 28722
I20260812 00:05:41.599275 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:41.599467 19693 external_mini_cluster.cc:1428] Setting key a8ba0403ff2f8e12f0ecf0c68e245c10
I20260812 00:05:41.604876 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.598698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:46741 (local address 127.19.59.126:43367)
0812 00:05:41.598738 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.598740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.598926 (+ 186us) server_negotiation.cc:407] Connection header received
0812 00:05:41.599034 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.599035 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.599045 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.599092 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:41.599496 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.600235 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.600939 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.601150 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.601227 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.602212 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:41.602213 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:41.602213 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:41.602221 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:41.603665 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.604023 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.604024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.604024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.604086 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.604308 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.604309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.604309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.604461 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:41.604539 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.604716 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.604786 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":19}
I20260812 00:05:41.604890 28878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.598650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:43367 (local address 127.19.59.66:46741)
0812 00:05:41.598820 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:41.598833 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:41.598979 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:41.599096 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:41.599097 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:41.599337 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:41.599402 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.599404 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.600312 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.600313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.600845 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.600847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.601227 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.601228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.601302 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.601776 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:41.601781 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:41.602105 (+ 324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:41.603771 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:41.603773 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:41.603773 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:41.603950 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:41.604170 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:41.604171 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:41.604171 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:41.604244 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:41.604542 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:41.604543 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:41.604595 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 00:05:41.604673 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 00:05:41.604783 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":83,"threads_started":1}
WARNING: no policy specified for oryx/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.67.keytab.
Entry for principal oryx/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.67.keytab.
I20260812 00:05:41.624856 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:43367
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.67.keytab
--principal=oryx/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:46421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:41.703151 28881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:41.703447 28881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:41.703485 28881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:41.704697 28881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:41.704763 28881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:41.704799 28881 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:05:41.704838 28881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:05:41.706211 28881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:46421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.67.keytab
--principal=oryx/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.59.126:43367
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:41.706441 28881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:41.706672 28881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:41.711455 28891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:41.711455 28888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:41.711483 28887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:41.711537 28881 server_base.cc:1034] running on GCE node
I20260812 00:05:41.711930 28881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:41.712177 28881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:41.713335 28881 hybrid_clock.cc:648] HybridClock initialized: now 1786493141713317 us; error 39 us; skew 500 ppm
Aug 12 00:05:41 dist-test-slave-6nmv krb5kdc[28425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493141, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:41.715807 28881 init.cc:377] Logged in from keytab as oryx/127.19.59.67@KRBTEST.COM (short username oryx)
I20260812 00:05:41.716259 28881 webserver.cc:460] Webserver started at http://127.19.59.67:39751/ using document root <none> and password file <none>
I20260812 00:05:41.716457 28881 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:41.716540 28881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:41.716687 28881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:41.717657 28881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "9620f9227e884c229db84a770e4ffae2"
format_stamp: "Formatted at 2026-08-12 00:05:41 on dist-test-slave-6nmv"
server_key: "a6523fefec2703f0dfa88af42dadbf83"
server_key_iv: "36fa2c86e2ba35ad67635eef8cdae22f"
server_key_version: "encryptionkey@0"
I20260812 00:05:41.718030 28881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "9620f9227e884c229db84a770e4ffae2"
format_stamp: "Formatted at 2026-08-12 00:05:41 on dist-test-slave-6nmv"
server_key: "a6523fefec2703f0dfa88af42dadbf83"
server_key_iv: "36fa2c86e2ba35ad67635eef8cdae22f"
server_key_version: "encryptionkey@0"
I20260812 00:05:41.719306 28881 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:41.719976 28899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:41.720137 28881 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:41.720227 28881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "9620f9227e884c229db84a770e4ffae2"
format_stamp: "Formatted at 2026-08-12 00:05:41 on dist-test-slave-6nmv"
server_key: "a6523fefec2703f0dfa88af42dadbf83"
server_key_iv: "36fa2c86e2ba35ad67635eef8cdae22f"
server_key_version: "encryptionkey@0"
I20260812 00:05:41.720299 28881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:41.739524 28881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:41.741420 28881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:41.741586 28881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:41.742236 28881 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:41.742295 28881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:41.742336 28881 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:41.742357 28881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:05:41 dist-test-slave-6nmv krb5kdc[28425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493141, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
I20260812 00:05:41.749905 28881 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:44127
I20260812 00:05:41.749974 29042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:44127 every 8 connection(s)
I20260812 00:05:41.750279 28881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:41.752733 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.742681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:51757 (local address 127.19.59.126:43367)
0812 00:05:41.742751 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.742754 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.743016 (+ 262us) server_negotiation.cc:407] Connection header received
0812 00:05:41.743763 (+ 747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.743765 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.743778 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.743842 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:41.744779 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.745367 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.747039 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.747248 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.747353 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.750073 (+ 2720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:41.750075 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:41.750075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:41.750083 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:41.751589 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.751968 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.751969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.751970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.752021 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.752236 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.752236 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.752236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.752336 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:41.752390 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.752612 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.752669 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 00:05:41.752904 28908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.742645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:43367 (local address 127.19.59.67:51757)
0812 00:05:41.742844 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:41.742898 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:41.743612 (+ 714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:41.743938 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:41.743943 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:41.744358 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:41.744676 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.744683 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.745443 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.745444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.746937 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.746940 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.747419 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.747420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.747523 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.748141 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:41.748149 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:41.749992 (+ 1843us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:41.751690 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:41.751694 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:41.751695 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:41.751903 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:41.752085 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:41.752085 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:41.752085 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:41.752179 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:41.752391 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:41.752395 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:41.752508 (+ 113us) client_negotiation.cc:769] Sending connection context
0812 00:05:41.752588 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 00:05:41.752701 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":95,"threads_started":1}
I20260812 00:05:41.753414 29044 heartbeater.cc:347] Connected to a master server at 127.19.59.126:43367
I20260812 00:05:41.753494 29044 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:41.753671 29044 heartbeater.cc:511] Master 127.19.59.126:43367 requested a full tablet report, sending...
I20260812 00:05:41.754083 28476 ts_manager.cc:194] Registered new tserver with Master: 9620f9227e884c229db84a770e4ffae2 (127.19.59.67:44127)
I20260812 00:05:41.754570 28476 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:51757
I20260812 00:05:41.759047 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.754443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:47957 (local address 127.19.59.126:43367)
0812 00:05:41.754484 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.754486 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.754583 (+ 97us) server_negotiation.cc:407] Connection header received
0812 00:05:41.754638 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.754639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.754648 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.754701 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:41.755156 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.755670 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.756255 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.756425 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.756499 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.757287 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:41.757287 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:41.757288 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:41.757292 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:41.758324 (+ 1032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.758580 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.758581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.758581 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.758625 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.758753 (+ 128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.758753 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.758753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.758822 (+ 69us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:41.758860 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.758953 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.759000 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:05:41.759073 29050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.754394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:43367 (local address 127.19.59.67:47957)
0812 00:05:41.754512 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:41.754522 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:41.754584 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:41.754784 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:41.754785 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:41.755009 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:41.755079 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.755081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.755749 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.755749 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.756195 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.756196 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.756506 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.756507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.756551 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.756960 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:41.756965 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:41.757224 (+ 259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:41.758383 (+ 1159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:41.758383 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:41.758384 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:41.758521 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:41.758675 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:41.758676 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:41.758676 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:41.758721 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:41.758869 (+ 148us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:41.758870 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:41.758899 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 00:05:41.758941 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 00:05:41.759004 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":68,"threads_started":1}
I20260812 00:05:41.759694 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 28881
I20260812 00:05:41.759800 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:41.759984 19693 external_mini_cluster.cc:1428] Setting key 8c7815c5c60d29daf582a0de078795a9
I20260812 00:05:41.760890 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:05:41 dist-test-slave-6nmv krb5kdc[28425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493141, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:05:41 dist-test-slave-6nmv krb5kdc[28425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:41 dist-test-slave-6nmv krb5kdc[28425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:05:41.781759 28530 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:41.776500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45356 (local address 127.19.59.126:43367)
0812 00:05:41.776544 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.776546 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.776555 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:41.776578 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.776579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.776589 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.776664 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:41.777320 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.777786 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.778629 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.778801 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.778879 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.781646 (+ 2767us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45356: BlockingRecv error: recv got EOF from 127.0.0.1:45356 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 12 00:05:41 dist-test-slave-6nmv krb5kdc[28425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493141, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
I20260812 00:05:41.788646 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.782595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45360 (local address 127.19.59.126:43367)
0812 00:05:41.782644 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.782646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.782796 (+ 150us) server_negotiation.cc:407] Connection header received
0812 00:05:41.782840 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.782840 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.782848 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.782897 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:41.783319 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.783752 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.784356 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.784519 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.784565 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.786524 (+ 1959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:41.786526 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:41.786526 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:41.786531 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:41.787848 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.788125 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.788126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.788126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.788174 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:41.788314 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:41.788314 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:41.788314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:41.788406 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:41.788466 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.788547 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.788594 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:05:41.790115 28476 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:41.791674 28476 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:41.798173 29067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.793883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:43929 (local address 127.0.0.1:39914)
0812 00:05:41.794185 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:41.794226 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:41.794295 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:41.794712 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:41.794715 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:41.794717 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:41.794782 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.794785 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.795708 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.795709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.796849 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.796852 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.797797 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.797799 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.797895 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.797910 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 00:05:41.798003 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 00:05:41.798082 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":55,"threads_started":1}
I20260812 00:05:41.798219 29068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.794021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39914 (local address 127.19.59.65:43929)
0812 00:05:41.794460 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.794463 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.794474 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:05:41.794517 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.794519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.794550 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.794632 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:41.794846 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.795621 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.796965 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.797700 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.797770 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.797873 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.798034 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.798097 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":114,"threads_started":1}
I20260812 00:05:41.798369 29069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.794233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40132 (local address 127.19.59.66:40917)
0812 00:05:41.794403 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.794408 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.794748 (+ 340us) server_negotiation.cc:407] Connection header received
0812 00:05:41.794796 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.794798 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.794813 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.794896 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:41.795005 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.796080 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.797031 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.797707 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.797770 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.797876 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.798219 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.798262 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":99,"threads_started":1}
I20260812 00:05:41.798404 29066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.794085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:40917 (local address 127.0.0.1:40132)
0812 00:05:41.794633 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:41.794641 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:41.794683 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:41.794889 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:41.794890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:41.794892 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:41.794949 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.794951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.796166 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.796167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.796917 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.796920 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.797911 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.797912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.798033 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.798039 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:05:41.798105 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 00:05:41.798161 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":51,"threads_started":1}
I20260812 00:05:41.798887 28632 tablet_service.cc:1467] Processing CreateTablet for tablet a77ae89fe3c64dc3a77d983135836c8d (DEFAULT_TABLE table=test-table [id=916c6ebce6a34316a8bd2a272fad89cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:41.799079 28796 tablet_service.cc:1467] Processing CreateTablet for tablet a77ae89fe3c64dc3a77d983135836c8d (DEFAULT_TABLE table=test-table [id=916c6ebce6a34316a8bd2a272fad89cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:41.799289 29065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.793901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:44127 (local address 127.0.0.1:37814)
0812 00:05:41.794480 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:41.794488 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:41.794556 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:41.794785 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:41.794786 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:41.794788 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:41.794846 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.794847 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.796127 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.796128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.797294 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.797297 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.799071 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.799072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.799134 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.799138 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:41.799177 (+ 39us) client_negotiation.cc:240] Negotiation successful
0812 00:05:41.799217 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":42,"threads_started":1}
I20260812 00:05:41.799285 28632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a77ae89fe3c64dc3a77d983135836c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:41.799382 28796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a77ae89fe3c64dc3a77d983135836c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:41.799575 29070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.794211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37814 (local address 127.19.59.67:44127)
0812 00:05:41.794431 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.794438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.794550 (+ 112us) server_negotiation.cc:407] Connection header received
0812 00:05:41.794624 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.794627 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.794645 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.794721 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:41.794928 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.796033 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.797381 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.799004 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.799061 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.799195 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.799220 (+ 25us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.799476 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":111,"threads_started":1}
I20260812 00:05:41.802745 29071 tablet_bootstrap.cc:492] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b: Bootstrap starting.
I20260812 00:05:41.803104 29072 tablet_bootstrap.cc:492] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe: Bootstrap starting.
I20260812 00:05:41.803411 29071 tablet_bootstrap.cc:654] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:41.803495 28962 tablet_service.cc:1467] Processing CreateTablet for tablet a77ae89fe3c64dc3a77d983135836c8d (DEFAULT_TABLE table=test-table [id=916c6ebce6a34316a8bd2a272fad89cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:41.803725 29072 tablet_bootstrap.cc:654] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:41.803759 29071 log.cc:824] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:41.803870 28962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a77ae89fe3c64dc3a77d983135836c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:41.804076 29072 log.cc:824] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:41.804809 29071 tablet_bootstrap.cc:492] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b: No bootstrap required, opened a new log
I20260812 00:05:41.804853 29072 tablet_bootstrap.cc:492] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe: No bootstrap required, opened a new log
I20260812 00:05:41.804914 29072 ts_tablet_manager.cc:1397] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:41.804898 29071 ts_tablet_manager.cc:1397] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:41.806612 29071 raft_consensus.cc:348] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.806782 29071 raft_consensus.cc:374] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:41.806819 29071 raft_consensus.cc:729] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6322906eb3c04fdcb1efa0f80b56135b, State: Initialized, Role: FOLLOWER
I20260812 00:05:41.806950 29071 consensus_queue.cc:260] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.806981 29072 raft_consensus.cc:348] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.807129 29072 raft_consensus.cc:374] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:41.807168 29072 raft_consensus.cc:729] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f57eace3355b4bb39ca07ea722340afe, State: Initialized, Role: FOLLOWER
I20260812 00:05:41.807236 29071 ts_tablet_manager.cc:1428] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:05:41.807274 29072 consensus_queue.cc:260] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.807533 29072 ts_tablet_manager.cc:1428] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:05:41.807622 28871 heartbeater.cc:503] Master 127.19.59.126:43367 was elected leader, sending a full tablet report...
I20260812 00:05:41.807672 28708 heartbeater.cc:503] Master 127.19.59.126:43367 was elected leader, sending a full tablet report...
I20260812 00:05:41.807765 29077 tablet_bootstrap.cc:492] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2: Bootstrap starting.
I20260812 00:05:41.808372 29077 tablet_bootstrap.cc:654] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:41.808637 29077 log.cc:824] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:41.809355 29077 tablet_bootstrap.cc:492] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2: No bootstrap required, opened a new log
I20260812 00:05:41.809419 29077 ts_tablet_manager.cc:1397] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:41.810940 29077 raft_consensus.cc:348] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.811061 29077 raft_consensus.cc:374] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:41.811082 29077 raft_consensus.cc:729] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9620f9227e884c229db84a770e4ffae2, State: Initialized, Role: FOLLOWER
I20260812 00:05:41.811182 29077 consensus_queue.cc:260] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.811388 29077 ts_tablet_manager.cc:1428] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:41.811474 29044 heartbeater.cc:503] Master 127.19.59.126:43367 was elected leader, sending a full tablet report...
I20260812 00:05:41.812361 29079 raft_consensus.cc:482] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:41.812445 29079 raft_consensus.cc:504] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.812712 29079 leader_election.cc:288] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65:43929), f57eace3355b4bb39ca07ea722340afe (127.19.59.66:40917)
I20260812 00:05:41.816454 29068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.812931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:57917 (local address 127.19.59.65:43929)
0812 00:05:41.812976 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.812978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.813201 (+ 223us) server_negotiation.cc:407] Connection header received
0812 00:05:41.813268 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.813269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.813278 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.813343 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:41.813500 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.814264 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.815631 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.816129 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.816199 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.816205 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.816368 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.816400 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:05:41.816455 29069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.813106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:38913 (local address 127.19.59.66:40917)
0812 00:05:41.813142 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.813143 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.813215 (+ 72us) server_negotiation.cc:407] Connection header received
0812 00:05:41.813268 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.813269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.813278 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.813343 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:41.813500 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.814263 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.815631 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.816130 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.816199 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.816205 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.816368 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.816400 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:05:41.816473 28908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.813012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:40917 (local address 127.19.59.67:38913)
0812 00:05:41.813138 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:41.813149 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:41.813204 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:41.813347 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:41.813348 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:41.813349 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:41.813428 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.813430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.814345 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.814346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.815551 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.815554 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.816208 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.816209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.816295 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.816301 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:05:41.816354 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 00:05:41.816393 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":68,"thread_start_us":85,"threads_started":1}
I20260812 00:05:41.816490 29080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.812878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:43929 (local address 127.19.59.67:57917)
0812 00:05:41.813138 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:41.813149 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:41.813204 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:41.813347 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:41.813348 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:41.813349 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:41.813431 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.813432 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.814345 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.814346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.815551 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.815554 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.816208 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.816209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.816295 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.816301 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:05:41.816354 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 00:05:41.816389 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"mutex_wait_us":63}
I20260812 00:05:41.816771 28817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a77ae89fe3c64dc3a77d983135836c8d" candidate_uuid: "9620f9227e884c229db84a770e4ffae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f57eace3355b4bb39ca07ea722340afe" is_pre_election: true
I20260812 00:05:41.816910 28817 raft_consensus.cc:2454] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9620f9227e884c229db84a770e4ffae2 in term 0.
I20260812 00:05:41.816879 28640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a77ae89fe3c64dc3a77d983135836c8d" candidate_uuid: "9620f9227e884c229db84a770e4ffae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6322906eb3c04fdcb1efa0f80b56135b" is_pre_election: true
I20260812 00:05:41.817011 28640 raft_consensus.cc:2454] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9620f9227e884c229db84a770e4ffae2 in term 0.
I20260812 00:05:41.817170 28901 leader_election.cc:302] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9620f9227e884c229db84a770e4ffae2, f57eace3355b4bb39ca07ea722340afe; no voters:
I20260812 00:05:41.817261 29079 raft_consensus.cc:2781] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:41.817338 29079 raft_consensus.cc:482] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:41.817369 29079 raft_consensus.cc:3037] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:41.817965 29079 raft_consensus.cc:504] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.818085 29079 leader_election.cc:288] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [CANDIDATE]: Term 1 election: Requested vote from peers 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65:43929), f57eace3355b4bb39ca07ea722340afe (127.19.59.66:40917)
I20260812 00:05:41.818244 28640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a77ae89fe3c64dc3a77d983135836c8d" candidate_uuid: "9620f9227e884c229db84a770e4ffae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6322906eb3c04fdcb1efa0f80b56135b"
I20260812 00:05:41.818305 28817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a77ae89fe3c64dc3a77d983135836c8d" candidate_uuid: "9620f9227e884c229db84a770e4ffae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f57eace3355b4bb39ca07ea722340afe"
I20260812 00:05:41.818317 28640 raft_consensus.cc:3037] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:41.818370 28817 raft_consensus.cc:3037] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:41.818861 28640 raft_consensus.cc:2454] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9620f9227e884c229db84a770e4ffae2 in term 1.
I20260812 00:05:41.818997 28817 raft_consensus.cc:2454] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9620f9227e884c229db84a770e4ffae2 in term 1.
I20260812 00:05:41.819003 28901 leader_election.cc:302] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6322906eb3c04fdcb1efa0f80b56135b, 9620f9227e884c229db84a770e4ffae2; no voters:
I20260812 00:05:41.819072 29079 raft_consensus.cc:2781] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:41.819200 29079 raft_consensus.cc:686] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [term 1 LEADER]: Becoming Leader. State: Replica: 9620f9227e884c229db84a770e4ffae2, State: Running, Role: LEADER
I20260812 00:05:41.819293 29079 consensus_queue.cc:237] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.819896 28475 catalog_manager.cc:5495] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9620f9227e884c229db84a770e4ffae2 (127.19.59.67). New cstate: current_term: 1 leader_uuid: "9620f9227e884c229db84a770e4ffae2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } health_report { overall_health: HEALTHY } } }
I20260812 00:05:41.825284 29070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.823186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37824 (local address 127.19.59.67:44127)
0812 00:05:41.823261 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.823263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.823270 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:41.823294 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.823295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.823308 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.823393 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:41.823540 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.823951 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.824695 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.824865 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.824927 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.825069 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:41.825139 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:41.825210 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.825230 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.825243 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:05:41.827033 28640 raft_consensus.cc:1261] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Refusing update from remote peer 9620f9227e884c229db84a770e4ffae2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:41.827035 28817 raft_consensus.cc:1261] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Refusing update from remote peer 9620f9227e884c229db84a770e4ffae2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:41.827334 29079 consensus_queue.cc:1035] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:41.827431 29081 consensus_queue.cc:1035] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:41.829689 29085 mvcc.cc:205] Tried to move back new op lower bound from 7317475908921556992 to 7317475908892315648. Current Snapshot: MvccSnapshot[applied={T|T < 7317475908921556992}]
I20260812 00:05:41.830085 29086 mvcc.cc:205] Tried to move back new op lower bound from 7317475908921556992 to 7317475908892315648. Current Snapshot: MvccSnapshot[applied={T|T < 7317475908921556992}]
I20260812 00:05:41.830245 29087 mvcc.cc:205] Tried to move back new op lower bound from 7317475908921556992 to 7317475908892315648. Current Snapshot: MvccSnapshot[applied={T|T < 7317475908921556992}]
I20260812 00:05:41.832062 28476 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:41.832142 28476 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:41.832818 28476 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d: Sending DeleteTablet for 3 replicas of tablet a77ae89fe3c64dc3a77d983135836c8d
I20260812 00:05:41.833168 28632 tablet_service.cc:1514] Processing DeleteTablet for tablet a77ae89fe3c64dc3a77d983135836c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:41 UTC) from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:39914
I20260812 00:05:41.833210 28962 tablet_service.cc:1514] Processing DeleteTablet for tablet a77ae89fe3c64dc3a77d983135836c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:41 UTC) from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:37814
I20260812 00:05:41.833215 28796 tablet_service.cc:1514] Processing DeleteTablet for tablet a77ae89fe3c64dc3a77d983135836c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:41 UTC) from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:40132
I20260812 00:05:41.833566 28476 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 00:05:41.833693 29094 tablet_replica.cc:330] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b: stopping tablet replica
W20260812 00:05:41.833712 28476 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:41.833812 29094 raft_consensus.cc:2229] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:41.833931 29094 raft_consensus.cc:2258] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:41.834810 29095 tablet_replica.cc:330] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe: stopping tablet replica
I20260812 00:05:41.834856 28962 tablet_service.cc:1467] Processing CreateTablet for tablet 9d6aa65140b74d9987e7e23cfacfb66c (DEFAULT_TABLE table=test-table [id=eac61b61e4374214b3397516bae85e51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:41.834941 28632 tablet_service.cc:1467] Processing CreateTablet for tablet 9d6aa65140b74d9987e7e23cfacfb66c (DEFAULT_TABLE table=test-table [id=eac61b61e4374214b3397516bae85e51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:41.834982 28962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d6aa65140b74d9987e7e23cfacfb66c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:41.835064 29095 raft_consensus.cc:2229] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:41.835083 28632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d6aa65140b74d9987e7e23cfacfb66c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:41.835242 29095 raft_consensus.cc:2258] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:41.835969 29077 tablet_bootstrap.cc:492] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2: Bootstrap starting.
I20260812 00:05:41.836241 29071 tablet_bootstrap.cc:492] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b: Bootstrap starting.
I20260812 00:05:41.836381 29077 tablet_bootstrap.cc:654] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:41.836609 29094 ts_tablet_manager.cc:1905] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:41.836650 29071 tablet_bootstrap.cc:654] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:41.837085 28796 tablet_service.cc:1467] Processing CreateTablet for tablet 9d6aa65140b74d9987e7e23cfacfb66c (DEFAULT_TABLE table=test-table [id=eac61b61e4374214b3397516bae85e51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:41.837194 28796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d6aa65140b74d9987e7e23cfacfb66c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:41.837231 29071 tablet_bootstrap.cc:492] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b: No bootstrap required, opened a new log
I20260812 00:05:41.837273 29071 ts_tablet_manager.cc:1397] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:41.837378 29095 ts_tablet_manager.cc:1905] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:41.837404 29071 raft_consensus.cc:348] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.837466 29071 raft_consensus.cc:374] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:41.837491 29071 raft_consensus.cc:729] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6322906eb3c04fdcb1efa0f80b56135b, State: Initialized, Role: FOLLOWER
I20260812 00:05:41.837540 29071 consensus_queue.cc:260] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.837620 29071 ts_tablet_manager.cc:1428] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:41.838408 29072 tablet_bootstrap.cc:492] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe: Bootstrap starting.
I20260812 00:05:41.838796 29072 tablet_bootstrap.cc:654] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:41.839430 29072 tablet_bootstrap.cc:492] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe: No bootstrap required, opened a new log
I20260812 00:05:41.839479 29072 ts_tablet_manager.cc:1397] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:41.839602 29072 raft_consensus.cc:348] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.839674 29072 raft_consensus.cc:374] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:41.839695 29072 raft_consensus.cc:729] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f57eace3355b4bb39ca07ea722340afe, State: Initialized, Role: FOLLOWER
I20260812 00:05:41.839732 29072 consensus_queue.cc:260] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.839773 29094 ts_tablet_manager.cc:1918] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:41.839818 29072 ts_tablet_manager.cc:1428] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:41.839846 29094 log.cc:1196] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/wal/wals/a77ae89fe3c64dc3a77d983135836c8d
I20260812 00:05:41.840103 29094 ts_tablet_manager.cc:1939] T a77ae89fe3c64dc3a77d983135836c8d P 6322906eb3c04fdcb1efa0f80b56135b: Deleting consensus metadata
I20260812 00:05:41.840459 29095 ts_tablet_manager.cc:1918] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:41.840452 28461 catalog_manager.cc:4841] TS 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65:43929): tablet a77ae89fe3c64dc3a77d983135836c8d (table test-table [id=916c6ebce6a34316a8bd2a272fad89cb]) successfully deleted
I20260812 00:05:41.840524 29095 log.cc:1196] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/a77ae89fe3c64dc3a77d983135836c8d
I20260812 00:05:41.840766 29095 ts_tablet_manager.cc:1939] T a77ae89fe3c64dc3a77d983135836c8d P f57eace3355b4bb39ca07ea722340afe: Deleting consensus metadata
I20260812 00:05:41.841135 28461 catalog_manager.cc:4841] TS f57eace3355b4bb39ca07ea722340afe (127.19.59.66:40917): tablet a77ae89fe3c64dc3a77d983135836c8d (table test-table [id=916c6ebce6a34316a8bd2a272fad89cb]) successfully deleted
I20260812 00:05:41.841369 29077 tablet_bootstrap.cc:492] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2: No bootstrap required, opened a new log
I20260812 00:05:41.841429 29077 ts_tablet_manager.cc:1397] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260812 00:05:41.841565 29077 raft_consensus.cc:348] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.841639 29077 raft_consensus.cc:374] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:41.841662 29077 raft_consensus.cc:729] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9620f9227e884c229db84a770e4ffae2, State: Initialized, Role: FOLLOWER
I20260812 00:05:41.841732 29077 consensus_queue.cc:260] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.841842 29096 tablet_replica.cc:330] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2: stopping tablet replica
I20260812 00:05:41.841849 29077 ts_tablet_manager.cc:1428] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:41.841944 29096 raft_consensus.cc:2229] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:41.842052 29096 raft_consensus.cc:2258] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:41.842486 29096 ts_tablet_manager.cc:1905] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:41.843976 29096 ts_tablet_manager.cc:1918] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:41.844062 29096 log.cc:1196] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/a77ae89fe3c64dc3a77d983135836c8d
I20260812 00:05:41.844313 29096 ts_tablet_manager.cc:1939] T a77ae89fe3c64dc3a77d983135836c8d P 9620f9227e884c229db84a770e4ffae2: Deleting consensus metadata
I20260812 00:05:41.844718 28463 catalog_manager.cc:4841] TS 9620f9227e884c229db84a770e4ffae2 (127.19.59.67:44127): tablet a77ae89fe3c64dc3a77d983135836c8d (table test-table [id=916c6ebce6a34316a8bd2a272fad89cb]) successfully deleted
W20260812 00:05:41.845010 28872 tablet.cc:2369] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:05:41.946671 28712 tablet.cc:2369] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:05:41.991353 29076 raft_consensus.cc:482] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:41.991463 29076 raft_consensus.cc:504] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.991837 29076 leader_election.cc:288] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65:43929), 9620f9227e884c229db84a770e4ffae2 (127.19.59.67:44127)
I20260812 00:05:41.996017 29070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.992164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:39535 (local address 127.19.59.67:44127)
0812 00:05:41.992213 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.992215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.992223 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:41.992261 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.992262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.992272 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.992370 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:41.992630 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.993380 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.995070 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.995628 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.995714 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.995723 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.995905 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.995946 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:05:41.996017 29068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.992151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:56739 (local address 127.19.59.65:43929)
0812 00:05:41.992202 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:41.992204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:41.992308 (+ 104us) server_negotiation.cc:407] Connection header received
0812 00:05:41.992337 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:41.992339 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:41.992349 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:41.992403 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:41.992627 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.993381 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.995070 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.995627 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.995714 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.995723 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:41.995895 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 00:05:41.995945 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:05:41.996018 28750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.992050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:44127 (local address 127.19.59.66:39535)
0812 00:05:41.992105 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:41.992118 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:41.992162 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:41.992408 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:41.992409 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:41.992412 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:41.992520 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.992523 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.993474 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.993475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.994939 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.994942 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.995723 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.995724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.995803 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.995811 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 00:05:41.995874 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:05:41.995919 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":102}
I20260812 00:05:41.996043 29100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:41.992050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:43929 (local address 127.19.59.66:56739)
0812 00:05:41.992226 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:41.992235 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:41.992291 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:41.992423 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:41.992423 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:41.992424 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:41.992544 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.992545 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.993471 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.993472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.994939 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:41.994942 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:41.995739 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:41.995740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:41.995803 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:41.995811 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 00:05:41.995874 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:05:41.995919 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":172,"thread_start_us":62,"threads_started":1}
I20260812 00:05:41.996315 28640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d6aa65140b74d9987e7e23cfacfb66c" candidate_uuid: "f57eace3355b4bb39ca07ea722340afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6322906eb3c04fdcb1efa0f80b56135b" is_pre_election: true
I20260812 00:05:41.996429 28640 raft_consensus.cc:2454] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f57eace3355b4bb39ca07ea722340afe in term 0.
I20260812 00:05:41.996367 28984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d6aa65140b74d9987e7e23cfacfb66c" candidate_uuid: "f57eace3355b4bb39ca07ea722340afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9620f9227e884c229db84a770e4ffae2" is_pre_election: true
I20260812 00:05:41.996505 28984 raft_consensus.cc:2454] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f57eace3355b4bb39ca07ea722340afe in term 0.
I20260812 00:05:41.996629 28741 leader_election.cc:302] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6322906eb3c04fdcb1efa0f80b56135b, f57eace3355b4bb39ca07ea722340afe; no voters:
I20260812 00:05:41.996800 29076 raft_consensus.cc:2781] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:41.996842 29076 raft_consensus.cc:482] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:41.996863 29076 raft_consensus.cc:3037] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:41.997627 29076 raft_consensus.cc:504] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:41.997784 29076 leader_election.cc:288] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [CANDIDATE]: Term 1 election: Requested vote from peers 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65:43929), 9620f9227e884c229db84a770e4ffae2 (127.19.59.67:44127)
I20260812 00:05:41.997967 28984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d6aa65140b74d9987e7e23cfacfb66c" candidate_uuid: "f57eace3355b4bb39ca07ea722340afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9620f9227e884c229db84a770e4ffae2"
I20260812 00:05:41.998049 28984 raft_consensus.cc:3037] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:41.998013 28640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d6aa65140b74d9987e7e23cfacfb66c" candidate_uuid: "f57eace3355b4bb39ca07ea722340afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6322906eb3c04fdcb1efa0f80b56135b"
I20260812 00:05:41.998101 28640 raft_consensus.cc:3037] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:41.998744 28984 raft_consensus.cc:2454] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f57eace3355b4bb39ca07ea722340afe in term 1.
I20260812 00:05:41.998884 28640 raft_consensus.cc:2454] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f57eace3355b4bb39ca07ea722340afe in term 1.
I20260812 00:05:41.998970 28743 leader_election.cc:302] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9620f9227e884c229db84a770e4ffae2, f57eace3355b4bb39ca07ea722340afe; no voters:
I20260812 00:05:41.999116 29076 raft_consensus.cc:2781] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:41.999257 29076 raft_consensus.cc:686] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [term 1 LEADER]: Becoming Leader. State: Replica: f57eace3355b4bb39ca07ea722340afe, State: Running, Role: LEADER
I20260812 00:05:41.999341 29076 consensus_queue.cc:237] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.000090 28476 catalog_manager.cc:5495] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe reported cstate change: term changed from 0 to 1, leader changed from <none> to f57eace3355b4bb39ca07ea722340afe (127.19.59.66). New cstate: current_term: 1 leader_uuid: "f57eace3355b4bb39ca07ea722340afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } health_report { overall_health: UNKNOWN } } }
W20260812 00:05:42.001129 29045 tablet.cc:2369] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 00:05:42 dist-test-slave-6nmv krb5kdc[28425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493141, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.126@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
I20260812 00:05:42.041024 29109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.034428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:43367 (local address 127.0.0.1:45374)
0812 00:05:42.034570 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.034580 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.034646 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.034764 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.034765 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.035069 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:42.035112 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.035113 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.035700 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.035700 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.036221 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.036222 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.036513 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.036514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.036554 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.037015 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:42.037020 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:42.038375 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:42.040041 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:42.040047 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:42.040049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:42.040291 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:42.040472 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:42.040473 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:42.040473 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:42.040537 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:42.040753 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:42.040759 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:42.040806 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.040876 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.040959 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":71,"threads_started":1}
I20260812 00:05:42.041133 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.034497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45374 (local address 127.19.59.126:43367)
0812 00:05:42.034593 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.034595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.034649 (+ 54us) server_negotiation.cc:407] Connection header received
0812 00:05:42.034687 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.034687 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.034696 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.034745 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:42.035179 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.035635 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.036291 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.036453 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.036498 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.038447 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:42.038449 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:42.038449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:42.038456 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:42.039969 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:42.040365 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:42.040366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:42.040366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:42.040414 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:42.040600 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:42.040601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:42.040601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:42.040699 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:42.040744 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.040896 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.041009 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":62}
I20260812 00:05:42.042882 28476 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:45374:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 00:05:42.043102 28476 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:42.044641 28632 tablet_service.cc:1467] Processing CreateTablet for tablet 151eda5f1d1e48dd8c4c79b304d16f35 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e21c659327d342f7a27dba7d524a5585]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:05:42.044673 28962 tablet_service.cc:1467] Processing CreateTablet for tablet 151eda5f1d1e48dd8c4c79b304d16f35 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e21c659327d342f7a27dba7d524a5585]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:05:42.044802 28632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 151eda5f1d1e48dd8c4c79b304d16f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:42.044803 28962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 151eda5f1d1e48dd8c4c79b304d16f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:42.044764 28796 tablet_service.cc:1467] Processing CreateTablet for tablet 151eda5f1d1e48dd8c4c79b304d16f35 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e21c659327d342f7a27dba7d524a5585]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:05:42.044906 28796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 151eda5f1d1e48dd8c4c79b304d16f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:42.046283 29071 tablet_bootstrap.cc:492] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b: Bootstrap starting.
I20260812 00:05:42.046293 29072 tablet_bootstrap.cc:492] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe: Bootstrap starting.
I20260812 00:05:42.046634 29072 tablet_bootstrap.cc:654] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:42.046657 29071 tablet_bootstrap.cc:654] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:42.046970 29077 tablet_bootstrap.cc:492] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2: Bootstrap starting.
I20260812 00:05:42.047291 29077 tablet_bootstrap.cc:654] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:42.047346 29072 tablet_bootstrap.cc:492] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe: No bootstrap required, opened a new log
I20260812 00:05:42.047397 29072 ts_tablet_manager.cc:1397] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:42.047763 29071 tablet_bootstrap.cc:492] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b: No bootstrap required, opened a new log
I20260812 00:05:42.047719 29072 raft_consensus.cc:348] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.047814 29072 raft_consensus.cc:374] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:42.047813 29071 ts_tablet_manager.cc:1397] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:05:42.047835 29072 raft_consensus.cc:729] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f57eace3355b4bb39ca07ea722340afe, State: Initialized, Role: FOLLOWER
I20260812 00:05:42.047879 29072 consensus_queue.cc:260] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.047967 29072 ts_tablet_manager.cc:1428] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 00:05:42.047950 29071 raft_consensus.cc:348] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.048009 29071 raft_consensus.cc:374] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:42.048027 29071 raft_consensus.cc:729] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6322906eb3c04fdcb1efa0f80b56135b, State: Initialized, Role: FOLLOWER
I20260812 00:05:42.047991 29076 tablet_replica.cc:439] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } } }
I20260812 00:05:42.048053 29076 tablet_replica.cc:442] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:42.048065 29071 consensus_queue.cc:260] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.048141 29071 ts_tablet_manager.cc:1428] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.048209 29075 tablet_replica.cc:439] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } } }
I20260812 00:05:42.048282 29075 tablet_replica.cc:442] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:42.048326 29077 tablet_bootstrap.cc:492] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2: No bootstrap required, opened a new log
I20260812 00:05:42.048355 29077 ts_tablet_manager.cc:1397] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:42.048483 29077 raft_consensus.cc:348] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.048564 29077 raft_consensus.cc:374] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:42.048584 29077 raft_consensus.cc:729] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9620f9227e884c229db84a770e4ffae2, State: Initialized, Role: FOLLOWER
I20260812 00:05:42.048641 29077 consensus_queue.cc:260] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.048760 29077 ts_tablet_manager.cc:1428] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:42.048853 29079 tablet_replica.cc:439] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } } }
I20260812 00:05:42.048921 29079 tablet_replica.cc:442] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:42.059998 29079 raft_consensus.cc:482] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:42.060079 29079 raft_consensus.cc:504] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.060148 29076 raft_consensus.cc:482] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:42.060202 29079 leader_election.cc:288] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65:43929), f57eace3355b4bb39ca07ea722340afe (127.19.59.66:40917)
I20260812 00:05:42.060206 29076 raft_consensus.cc:504] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.060326 29076 leader_election.cc:288] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65:43929), 9620f9227e884c229db84a770e4ffae2 (127.19.59.67:44127)
I20260812 00:05:42.060410 28640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "151eda5f1d1e48dd8c4c79b304d16f35" candidate_uuid: "9620f9227e884c229db84a770e4ffae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6322906eb3c04fdcb1efa0f80b56135b" is_pre_election: true
I20260812 00:05:42.060458 28655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "151eda5f1d1e48dd8c4c79b304d16f35" candidate_uuid: "f57eace3355b4bb39ca07ea722340afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6322906eb3c04fdcb1efa0f80b56135b" is_pre_election: true
I20260812 00:05:42.060500 28640 raft_consensus.cc:2454] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9620f9227e884c229db84a770e4ffae2 in term 0.
I20260812 00:05:42.060514 28817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "151eda5f1d1e48dd8c4c79b304d16f35" candidate_uuid: "9620f9227e884c229db84a770e4ffae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f57eace3355b4bb39ca07ea722340afe" is_pre_election: true
I20260812 00:05:42.060539 28984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "151eda5f1d1e48dd8c4c79b304d16f35" candidate_uuid: "f57eace3355b4bb39ca07ea722340afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9620f9227e884c229db84a770e4ffae2" is_pre_election: true
I20260812 00:05:42.060597 28984 raft_consensus.cc:2454] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f57eace3355b4bb39ca07ea722340afe in term 0.
I20260812 00:05:42.060596 28817 raft_consensus.cc:2454] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9620f9227e884c229db84a770e4ffae2 in term 0.
I20260812 00:05:42.060636 28901 leader_election.cc:302] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6322906eb3c04fdcb1efa0f80b56135b, 9620f9227e884c229db84a770e4ffae2; no voters:
I20260812 00:05:42.060710 28743 leader_election.cc:302] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9620f9227e884c229db84a770e4ffae2, f57eace3355b4bb39ca07ea722340afe; no voters: 6322906eb3c04fdcb1efa0f80b56135b
I20260812 00:05:42.060740 29079 raft_consensus.cc:2781] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:42.060774 29079 raft_consensus.cc:482] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:42.060808 29079 raft_consensus.cc:3037] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:42.060819 29076 raft_consensus.cc:2781] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:42.060859 29076 raft_consensus.cc:482] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:42.060885 29076 raft_consensus.cc:3037] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:42.061549 29076 raft_consensus.cc:504] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.061547 29079 raft_consensus.cc:504] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.061657 29079 leader_election.cc:288] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [CANDIDATE]: Term 1 election: Requested vote from peers 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65:43929), f57eace3355b4bb39ca07ea722340afe (127.19.59.66:40917)
I20260812 00:05:42.061666 29076 leader_election.cc:288] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [CANDIDATE]: Term 1 election: Requested vote from peers 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65:43929), 9620f9227e884c229db84a770e4ffae2 (127.19.59.67:44127)
I20260812 00:05:42.061815 28655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "151eda5f1d1e48dd8c4c79b304d16f35" candidate_uuid: "f57eace3355b4bb39ca07ea722340afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6322906eb3c04fdcb1efa0f80b56135b"
I20260812 00:05:42.061816 28984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "151eda5f1d1e48dd8c4c79b304d16f35" candidate_uuid: "f57eace3355b4bb39ca07ea722340afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9620f9227e884c229db84a770e4ffae2"
I20260812 00:05:42.061906 28655 raft_consensus.cc:3037] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:42.061882 28640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "151eda5f1d1e48dd8c4c79b304d16f35" candidate_uuid: "9620f9227e884c229db84a770e4ffae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6322906eb3c04fdcb1efa0f80b56135b"
I20260812 00:05:42.061928 28984 raft_consensus.cc:2379] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f57eace3355b4bb39ca07ea722340afe in current term 1: Already voted for candidate 9620f9227e884c229db84a770e4ffae2 in this term.
I20260812 00:05:42.062107 28817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "151eda5f1d1e48dd8c4c79b304d16f35" candidate_uuid: "9620f9227e884c229db84a770e4ffae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f57eace3355b4bb39ca07ea722340afe"
I20260812 00:05:42.062203 28817 raft_consensus.cc:2379] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9620f9227e884c229db84a770e4ffae2 in current term 1: Already voted for candidate f57eace3355b4bb39ca07ea722340afe in this term.
I20260812 00:05:42.062323 28901 leader_election.cc:302] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9620f9227e884c229db84a770e4ffae2; no voters: 6322906eb3c04fdcb1efa0f80b56135b, f57eace3355b4bb39ca07ea722340afe
I20260812 00:05:42.062433 29079 raft_consensus.cc:2726] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 00:05:42.062649 28655 raft_consensus.cc:2454] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f57eace3355b4bb39ca07ea722340afe in term 1.
I20260812 00:05:42.062906 28741 leader_election.cc:302] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6322906eb3c04fdcb1efa0f80b56135b, f57eace3355b4bb39ca07ea722340afe; no voters: 9620f9227e884c229db84a770e4ffae2
I20260812 00:05:42.063027 29076 raft_consensus.cc:2781] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:42.063100 29076 raft_consensus.cc:686] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [term 1 LEADER]: Becoming Leader. State: Replica: f57eace3355b4bb39ca07ea722340afe, State: Running, Role: LEADER
I20260812 00:05:42.063145 29076 consensus_queue.cc:237] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.063447 29101 tablet_replica.cc:439] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe: TxnStatusTablet state changed. Reason: New leader f57eace3355b4bb39ca07ea722340afe. Latest consensus state: current_term: 1 leader_uuid: "f57eace3355b4bb39ca07ea722340afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } } }
I20260812 00:05:42.063561 29101 tablet_replica.cc:442] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:05:42.063742 29115 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 00:05:42.063827 29115 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 00:05:42.063752 28475 catalog_manager.cc:5495] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe reported cstate change: term changed from 0 to 1, leader changed from <none> to f57eace3355b4bb39ca07ea722340afe (127.19.59.66). New cstate: current_term: 1 leader_uuid: "f57eace3355b4bb39ca07ea722340afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } health_report { overall_health: UNKNOWN } } }
I20260812 00:05:42.070118 29069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.067606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40136 (local address 127.19.59.66:40917)
0812 00:05:42.067641 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.067643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.067676 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:05:42.067762 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.067763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.067776 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.067827 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:42.067930 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.068380 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.069364 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.069540 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.069590 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.069777 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:42.069911 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:42.069963 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.070050 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.070066 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 00:05:42.070165 29109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.067561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:40917 (local address 127.0.0.1:40136)
0812 00:05:42.067634 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.067644 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.067692 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.067830 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.067831 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.067832 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:05:42.067875 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.067877 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.068461 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.068462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.069284 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.069287 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.069612 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.069613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.069673 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.069691 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:05:42.069973 (+ 282us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:05:42.069983 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.070039 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.070096 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 00:05:42.071034 28655 raft_consensus.cc:1261] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Refusing update from remote peer f57eace3355b4bb39ca07ea722340afe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:42.071069 28984 raft_consensus.cc:1261] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Refusing update from remote peer f57eace3355b4bb39ca07ea722340afe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:42.071298 29076 consensus_queue.cc:1035] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [LEADER]: Connected to new peer: Peer: permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:42.071430 29101 consensus_queue.cc:1035] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:42.071985 29075 tablet_replica.cc:439] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b: TxnStatusTablet state changed. Reason: New leader f57eace3355b4bb39ca07ea722340afe. Latest consensus state: current_term: 1 leader_uuid: "f57eace3355b4bb39ca07ea722340afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } } }
I20260812 00:05:42.072093 29075 tablet_replica.cc:442] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:42.072377 29079 tablet_replica.cc:439] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2: TxnStatusTablet state changed. Reason: New leader f57eace3355b4bb39ca07ea722340afe. Latest consensus state: current_term: 1 leader_uuid: "f57eace3355b4bb39ca07ea722340afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } } }
I20260812 00:05:42.072463 29079 tablet_replica.cc:442] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:42.072585 29076 tablet_replica.cc:439] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f57eace3355b4bb39ca07ea722340afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } } }
I20260812 00:05:42.072679 29076 tablet_replica.cc:442] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:05:42.072768 29076 tablet_replica.cc:439] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f57eace3355b4bb39ca07ea722340afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } } }
I20260812 00:05:42.072820 29076 tablet_replica.cc:442] T 151eda5f1d1e48dd8c4c79b304d16f35 P f57eace3355b4bb39ca07ea722340afe: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:05:42.073526 29075 tablet_replica.cc:439] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f57eace3355b4bb39ca07ea722340afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } } }
I20260812 00:05:42.073625 29075 tablet_replica.cc:442] T 151eda5f1d1e48dd8c4c79b304d16f35 P 6322906eb3c04fdcb1efa0f80b56135b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:42.073947 29079 tablet_replica.cc:439] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f57eace3355b4bb39ca07ea722340afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } } }
I20260812 00:05:42.074028 29079 tablet_replica.cc:442] T 151eda5f1d1e48dd8c4c79b304d16f35 P 9620f9227e884c229db84a770e4ffae2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:05:42.077445 29069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.075001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40140 (local address 127.19.59.66:40917)
0812 00:05:42.075033 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.075041 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.075048 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:42.075067 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.075068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.075076 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.075123 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:42.075250 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.075645 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.076705 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.076863 (+ 158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.076912 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.077125 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:42.077240 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:42.077293 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.077365 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.077381 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 00:05:42.081943 29069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.079819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:39831 (local address 127.19.59.66:40917)
0812 00:05:42.079852 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.079853 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.079861 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:42.079924 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.079925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.079933 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.079979 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:42.080102 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.080485 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.081231 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.081415 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.081491 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.081676 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:42.081703 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:42.081766 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.081854 (+ 88us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.081872 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:05:42.081948 28878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.079761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:40917 (local address 127.19.59.66:39831)
0812 00:05:42.079823 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.079834 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.079872 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.079982 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.079983 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.079983 (+ 0us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:05:42.080037 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.080038 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.080583 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.080584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.081140 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.081142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.081493 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.081493 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.081559 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.081572 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:05:42.081767 (+ 195us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:05:42.081769 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.081860 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.081891 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:05:42.084254 28655 raft_consensus.cc:1261] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Refusing update from remote peer f57eace3355b4bb39ca07ea722340afe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:42.084299 28984 raft_consensus.cc:1261] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Refusing update from remote peer f57eace3355b4bb39ca07ea722340afe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:42.084477 29101 consensus_queue.cc:1035] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:42.084563 29076 consensus_queue.cc:1035] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [LEADER]: Connected to new peer: Peer: permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:42.095687 28475 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:42.095783 28475 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:42.096405 28475 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d: Sending DeleteTablet for 3 replicas of tablet 9d6aa65140b74d9987e7e23cfacfb66c
I20260812 00:05:42.096665 28962 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d6aa65140b74d9987e7e23cfacfb66c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:42 UTC) from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:37814
I20260812 00:05:42.096680 28632 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d6aa65140b74d9987e7e23cfacfb66c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:42 UTC) from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:39914
I20260812 00:05:42.096683 28796 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d6aa65140b74d9987e7e23cfacfb66c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:42 UTC) from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:40132
I20260812 00:05:42.096771 29096 tablet_replica.cc:330] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2: stopping tablet replica
I20260812 00:05:42.096845 29096 raft_consensus.cc:2229] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:42.096884 29096 raft_consensus.cc:2258] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:42.096954 29094 tablet_replica.cc:330] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b: stopping tablet replica
I20260812 00:05:42.097018 29094 raft_consensus.cc:2229] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:42.097054 29094 raft_consensus.cc:2258] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:42.097114 29095 tablet_replica.cc:330] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe: stopping tablet replica
I20260812 00:05:42.097155 29095 raft_consensus.cc:2229] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:42.097213 29095 raft_consensus.cc:2258] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:42.097601 29095 ts_tablet_manager.cc:1905] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:42.099264 29095 ts_tablet_manager.cc:1918] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:05:42.099315 29095 log.cc:1196] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/9d6aa65140b74d9987e7e23cfacfb66c
I20260812 00:05:42.099539 29095 ts_tablet_manager.cc:1939] T 9d6aa65140b74d9987e7e23cfacfb66c P f57eace3355b4bb39ca07ea722340afe: Deleting consensus metadata
I20260812 00:05:42.099961 29096 ts_tablet_manager.cc:1905] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:42.099967 28461 catalog_manager.cc:4841] TS f57eace3355b4bb39ca07ea722340afe (127.19.59.66:40917): tablet 9d6aa65140b74d9987e7e23cfacfb66c (table test-table [id=eac61b61e4374214b3397516bae85e51]) successfully deleted
I20260812 00:05:42.101226 29096 ts_tablet_manager.cc:1918] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:05:42.101301 29096 log.cc:1196] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/9d6aa65140b74d9987e7e23cfacfb66c
I20260812 00:05:42.101504 29096 ts_tablet_manager.cc:1939] T 9d6aa65140b74d9987e7e23cfacfb66c P 9620f9227e884c229db84a770e4ffae2: Deleting consensus metadata
I20260812 00:05:42.101831 29094 ts_tablet_manager.cc:1905] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:42.101967 28463 catalog_manager.cc:4841] TS 9620f9227e884c229db84a770e4ffae2 (127.19.59.67:44127): tablet 9d6aa65140b74d9987e7e23cfacfb66c (table test-table [id=eac61b61e4374214b3397516bae85e51]) successfully deleted
I20260812 00:05:42.103176 29094 ts_tablet_manager.cc:1918] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:05:42.103230 29094 log.cc:1196] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/wal/wals/9d6aa65140b74d9987e7e23cfacfb66c
I20260812 00:05:42.103413 29094 ts_tablet_manager.cc:1939] T 9d6aa65140b74d9987e7e23cfacfb66c P 6322906eb3c04fdcb1efa0f80b56135b: Deleting consensus metadata
I20260812 00:05:42.103693 28461 catalog_manager.cc:4841] TS 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65:43929): tablet 9d6aa65140b74d9987e7e23cfacfb66c (table test-table [id=eac61b61e4374214b3397516bae85e51]) successfully deleted
Aug 12 00:05:42 dist-test-slave-6nmv krb5kdc[28425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493142, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:05:42 dist-test-slave-6nmv krb5kdc[28425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:42 dist-test-slave-6nmv krb5kdc[28425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:05:42.120992 28530 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:42.115188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45384 (local address 127.19.59.126:43367)
0812 00:05:42.115257 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.115260 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.115371 (+ 111us) server_negotiation.cc:407] Connection header received
0812 00:05:42.115450 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.115450 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.115460 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.115507 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:42.116206 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.116666 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.117712 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.117930 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.117979 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.120917 (+ 2938us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45384: BlockingRecv error: recv got EOF from 127.0.0.1:45384 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 00:05:42 dist-test-slave-6nmv krb5kdc[28425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493142, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM
I20260812 00:05:42.128940 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.121871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45400 (local address 127.19.59.126:43367)
0812 00:05:42.121975 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.121977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.121988 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:05:42.122071 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.122072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.122083 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.122140 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:42.122521 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.123228 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.123864 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.124158 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.124234 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.126377 (+ 2143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:42.126379 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:42.126379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:42.126387 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:42.127866 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:42.128187 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:42.128188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:42.128189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:42.128257 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:42.128433 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:42.128434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:42.128435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:42.128588 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:42.128700 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.128774 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.128847 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 00:05:42.130431 28475 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45400:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:42.130609 28475 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:42.132036 28962 tablet_service.cc:1467] Processing CreateTablet for tablet bd710c1aa48549b693da7bf1e42003bb (DEFAULT_TABLE table=test-table [id=8a642dc2092d45cbb8ad0de30e74fe7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:42.132117 28796 tablet_service.cc:1467] Processing CreateTablet for tablet bd710c1aa48549b693da7bf1e42003bb (DEFAULT_TABLE table=test-table [id=8a642dc2092d45cbb8ad0de30e74fe7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:42.132184 28962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd710c1aa48549b693da7bf1e42003bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:42.132208 28632 tablet_service.cc:1467] Processing CreateTablet for tablet bd710c1aa48549b693da7bf1e42003bb (DEFAULT_TABLE table=test-table [id=8a642dc2092d45cbb8ad0de30e74fe7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:42.132272 28796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd710c1aa48549b693da7bf1e42003bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:42.132328 28632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd710c1aa48549b693da7bf1e42003bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:42.133546 29077 tablet_bootstrap.cc:492] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2: Bootstrap starting.
I20260812 00:05:42.133631 29071 tablet_bootstrap.cc:492] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b: Bootstrap starting.
I20260812 00:05:42.133911 29077 tablet_bootstrap.cc:654] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:42.134145 29071 tablet_bootstrap.cc:654] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:42.134508 29072 tablet_bootstrap.cc:492] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe: Bootstrap starting.
I20260812 00:05:42.134575 29077 tablet_bootstrap.cc:492] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2: No bootstrap required, opened a new log
I20260812 00:05:42.134626 29077 ts_tablet_manager.cc:1397] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:42.134747 29077 raft_consensus.cc:348] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.134822 29077 raft_consensus.cc:374] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:42.134850 29077 raft_consensus.cc:729] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9620f9227e884c229db84a770e4ffae2, State: Initialized, Role: FOLLOWER
I20260812 00:05:42.134891 29077 consensus_queue.cc:260] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.134954 29072 tablet_bootstrap.cc:654] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:42.134990 29077 ts_tablet_manager.cc:1428] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:42.135612 29071 tablet_bootstrap.cc:492] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b: No bootstrap required, opened a new log
I20260812 00:05:42.135664 29071 ts_tablet_manager.cc:1397] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:42.135851 29071 raft_consensus.cc:348] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.135929 29071 raft_consensus.cc:374] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:42.135954 29071 raft_consensus.cc:729] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6322906eb3c04fdcb1efa0f80b56135b, State: Initialized, Role: FOLLOWER
I20260812 00:05:42.136003 29071 consensus_queue.cc:260] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.136116 29071 ts_tablet_manager.cc:1428] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.136538 29072 tablet_bootstrap.cc:492] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe: No bootstrap required, opened a new log
I20260812 00:05:42.136593 29072 ts_tablet_manager.cc:1397] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:42.136734 29072 raft_consensus.cc:348] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.136803 29072 raft_consensus.cc:374] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:42.136823 29072 raft_consensus.cc:729] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f57eace3355b4bb39ca07ea722340afe, State: Initialized, Role: FOLLOWER
I20260812 00:05:42.136861 29072 consensus_queue.cc:260] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.136947 29072 ts_tablet_manager.cc:1428] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:42.335410 29079 raft_consensus.cc:482] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:42.335534 29079 raft_consensus.cc:504] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.335666 29079 leader_election.cc:288] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65:43929), f57eace3355b4bb39ca07ea722340afe (127.19.59.66:40917)
I20260812 00:05:42.335934 28655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd710c1aa48549b693da7bf1e42003bb" candidate_uuid: "9620f9227e884c229db84a770e4ffae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6322906eb3c04fdcb1efa0f80b56135b" is_pre_election: true
I20260812 00:05:42.335968 28817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd710c1aa48549b693da7bf1e42003bb" candidate_uuid: "9620f9227e884c229db84a770e4ffae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f57eace3355b4bb39ca07ea722340afe" is_pre_election: true
I20260812 00:05:42.336042 28655 raft_consensus.cc:2454] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9620f9227e884c229db84a770e4ffae2 in term 0.
I20260812 00:05:42.336076 28817 raft_consensus.cc:2454] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9620f9227e884c229db84a770e4ffae2 in term 0.
I20260812 00:05:42.336251 28901 leader_election.cc:302] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9620f9227e884c229db84a770e4ffae2, f57eace3355b4bb39ca07ea722340afe; no voters:
I20260812 00:05:42.336369 29079 raft_consensus.cc:2781] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:42.336418 29079 raft_consensus.cc:482] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:42.336458 29079 raft_consensus.cc:3037] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:42.337512 29079 raft_consensus.cc:504] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.337648 29079 leader_election.cc:288] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [CANDIDATE]: Term 1 election: Requested vote from peers 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65:43929), f57eace3355b4bb39ca07ea722340afe (127.19.59.66:40917)
I20260812 00:05:42.337845 28817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd710c1aa48549b693da7bf1e42003bb" candidate_uuid: "9620f9227e884c229db84a770e4ffae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f57eace3355b4bb39ca07ea722340afe"
I20260812 00:05:42.337834 28655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd710c1aa48549b693da7bf1e42003bb" candidate_uuid: "9620f9227e884c229db84a770e4ffae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6322906eb3c04fdcb1efa0f80b56135b"
I20260812 00:05:42.337914 28655 raft_consensus.cc:3037] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:42.337913 28817 raft_consensus.cc:3037] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:42.338723 28655 raft_consensus.cc:2454] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9620f9227e884c229db84a770e4ffae2 in term 1.
I20260812 00:05:42.338724 28817 raft_consensus.cc:2454] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9620f9227e884c229db84a770e4ffae2 in term 1.
I20260812 00:05:42.338953 28901 leader_election.cc:302] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6322906eb3c04fdcb1efa0f80b56135b, 9620f9227e884c229db84a770e4ffae2; no voters:
I20260812 00:05:42.339044 29079 raft_consensus.cc:2781] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:42.339161 29079 raft_consensus.cc:686] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [term 1 LEADER]: Becoming Leader. State: Replica: 9620f9227e884c229db84a770e4ffae2, State: Running, Role: LEADER
I20260812 00:05:42.339227 29079 consensus_queue.cc:237] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.339841 28475 catalog_manager.cc:5495] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9620f9227e884c229db84a770e4ffae2 (127.19.59.67). New cstate: current_term: 1 leader_uuid: "9620f9227e884c229db84a770e4ffae2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } health_report { overall_health: HEALTHY } } }
I20260812 00:05:42.364603 29070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.362585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37830 (local address 127.19.59.67:44127)
0812 00:05:42.362628 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.362630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.362637 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:42.362681 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.362682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.362690 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.362731 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:42.362847 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.363271 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.363971 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.364147 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.364197 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.364381 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:42.364421 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:42.364477 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.364528 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.364548 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:05:42.365496 28817 raft_consensus.cc:1261] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Refusing update from remote peer 9620f9227e884c229db84a770e4ffae2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:42.365501 28655 raft_consensus.cc:1261] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Refusing update from remote peer 9620f9227e884c229db84a770e4ffae2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:42.365749 29079 consensus_queue.cc:1035] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:42.365964 29151 consensus_queue.cc:1035] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:42.368645 28476 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:42.368760 28476 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:42.369378 28476 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d: Sending DeleteTablet for 3 replicas of tablet bd710c1aa48549b693da7bf1e42003bb
I20260812 00:05:42.369626 28962 tablet_service.cc:1514] Processing DeleteTablet for tablet bd710c1aa48549b693da7bf1e42003bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:42 UTC) from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:37814
I20260812 00:05:42.369663 28632 tablet_service.cc:1514] Processing DeleteTablet for tablet bd710c1aa48549b693da7bf1e42003bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:42 UTC) from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:39914
I20260812 00:05:42.369683 28796 tablet_service.cc:1514] Processing DeleteTablet for tablet bd710c1aa48549b693da7bf1e42003bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:42 UTC) from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:40132
I20260812 00:05:42.369730 29096 tablet_replica.cc:330] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2: stopping tablet replica
I20260812 00:05:42.369799 29096 raft_consensus.cc:2229] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:42.369791 29095 tablet_replica.cc:330] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe: stopping tablet replica
I20260812 00:05:42.369858 29095 raft_consensus.cc:2229] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:42.369869 29094 tablet_replica.cc:330] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b: stopping tablet replica
I20260812 00:05:42.369890 29096 raft_consensus.cc:2258] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:42.369910 29095 raft_consensus.cc:2258] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:42.369920 29094 raft_consensus.cc:2229] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:42.369962 29094 raft_consensus.cc:2258] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:42.370242 29095 ts_tablet_manager.cc:1905] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:42.370357 29096 ts_tablet_manager.cc:1905] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:42.370357 29094 ts_tablet_manager.cc:1905] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:42.371619 29095 ts_tablet_manager.cc:1918] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:42.371696 29095 log.cc:1196] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/bd710c1aa48549b693da7bf1e42003bb
I20260812 00:05:42.371826 29096 ts_tablet_manager.cc:1918] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:42.371826 29094 ts_tablet_manager.cc:1918] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:42.371879 29096 log.cc:1196] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/bd710c1aa48549b693da7bf1e42003bb
I20260812 00:05:42.371889 29094 log.cc:1196] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-0/wal/wals/bd710c1aa48549b693da7bf1e42003bb
I20260812 00:05:42.371920 29095 ts_tablet_manager.cc:1939] T bd710c1aa48549b693da7bf1e42003bb P f57eace3355b4bb39ca07ea722340afe: Deleting consensus metadata
I20260812 00:05:42.372103 29096 ts_tablet_manager.cc:1939] T bd710c1aa48549b693da7bf1e42003bb P 9620f9227e884c229db84a770e4ffae2: Deleting consensus metadata
I20260812 00:05:42.372103 29094 ts_tablet_manager.cc:1939] T bd710c1aa48549b693da7bf1e42003bb P 6322906eb3c04fdcb1efa0f80b56135b: Deleting consensus metadata
I20260812 00:05:42.372185 28461 catalog_manager.cc:4841] TS f57eace3355b4bb39ca07ea722340afe (127.19.59.66:40917): tablet bd710c1aa48549b693da7bf1e42003bb (table test-table [id=8a642dc2092d45cbb8ad0de30e74fe7d]) successfully deleted
I20260812 00:05:42.372457 28461 catalog_manager.cc:4841] TS 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65:43929): tablet bd710c1aa48549b693da7bf1e42003bb (table test-table [id=8a642dc2092d45cbb8ad0de30e74fe7d]) successfully deleted
I20260812 00:05:42.372517 28476 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45400:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:42.372695 28476 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:42.373049 28463 catalog_manager.cc:4841] TS 9620f9227e884c229db84a770e4ffae2 (127.19.59.67:44127): tablet bd710c1aa48549b693da7bf1e42003bb (table test-table [id=8a642dc2092d45cbb8ad0de30e74fe7d]) successfully deleted
I20260812 00:05:42.373824 28962 tablet_service.cc:1467] Processing CreateTablet for tablet 5a11b826049a45aca1a863fc287d3cfb (DEFAULT_TABLE table=test-table [id=5bfb3141566a46b5b1a730b696f70c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:42.373828 28632 tablet_service.cc:1467] Processing CreateTablet for tablet 5a11b826049a45aca1a863fc287d3cfb (DEFAULT_TABLE table=test-table [id=5bfb3141566a46b5b1a730b696f70c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:42.373828 28796 tablet_service.cc:1467] Processing CreateTablet for tablet 5a11b826049a45aca1a863fc287d3cfb (DEFAULT_TABLE table=test-table [id=5bfb3141566a46b5b1a730b696f70c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:42.373934 28796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a11b826049a45aca1a863fc287d3cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:42.373936 28632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a11b826049a45aca1a863fc287d3cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:42.373934 28962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a11b826049a45aca1a863fc287d3cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:42.374840 29077 tablet_bootstrap.cc:492] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2: Bootstrap starting.
I20260812 00:05:42.375092 29072 tablet_bootstrap.cc:492] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe: Bootstrap starting.
I20260812 00:05:42.375095 29071 tablet_bootstrap.cc:492] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b: Bootstrap starting.
I20260812 00:05:42.375221 29077 tablet_bootstrap.cc:654] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:42.375406 29072 tablet_bootstrap.cc:654] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:42.375501 29071 tablet_bootstrap.cc:654] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:42.375882 29077 tablet_bootstrap.cc:492] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2: No bootstrap required, opened a new log
I20260812 00:05:42.375945 29077 ts_tablet_manager.cc:1397] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:42.375998 29072 tablet_bootstrap.cc:492] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe: No bootstrap required, opened a new log
I20260812 00:05:42.376030 29072 ts_tablet_manager.cc:1397] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:42.376055 29077 raft_consensus.cc:348] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.376116 29077 raft_consensus.cc:374] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:42.376133 29077 raft_consensus.cc:729] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9620f9227e884c229db84a770e4ffae2, State: Initialized, Role: FOLLOWER
I20260812 00:05:42.376140 29072 raft_consensus.cc:348] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.376201 29072 raft_consensus.cc:374] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:42.376199 29077 consensus_queue.cc:260] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.376223 29072 raft_consensus.cc:729] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f57eace3355b4bb39ca07ea722340afe, State: Initialized, Role: FOLLOWER
I20260812 00:05:42.376228 29071 tablet_bootstrap.cc:492] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b: No bootstrap required, opened a new log
I20260812 00:05:42.376266 29071 ts_tablet_manager.cc:1397] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:42.376266 29072 consensus_queue.cc:260] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.376291 29077 ts_tablet_manager.cc:1428] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.376362 29072 ts_tablet_manager.cc:1428] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.376400 29071 raft_consensus.cc:348] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.376477 29071 raft_consensus.cc:374] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:42.376510 29071 raft_consensus.cc:729] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6322906eb3c04fdcb1efa0f80b56135b, State: Initialized, Role: FOLLOWER
I20260812 00:05:42.376559 29071 consensus_queue.cc:260] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.376639 29071 ts_tablet_manager.cc:1428] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.633447 29075 raft_consensus.cc:482] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:42.633569 29075 raft_consensus.cc:504] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.633988 29075 leader_election.cc:288] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f57eace3355b4bb39ca07ea722340afe (127.19.59.66:40917), 9620f9227e884c229db84a770e4ffae2 (127.19.59.67:44127)
I20260812 00:05:42.636894 29070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.634278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:55383 (local address 127.19.59.67:44127)
0812 00:05:42.634336 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.634339 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.634391 (+ 52us) server_negotiation.cc:407] Connection header received
0812 00:05:42.634547 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.634549 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.634564 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.634639 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:42.634777 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.635255 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.636181 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.636532 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.636615 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.636623 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.636795 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.636831 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:05:42.636909 29161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.634191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:44127 (local address 127.19.59.65:55383)
0812 00:05:42.634323 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.634336 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.634409 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.634645 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.634646 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.634648 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:42.634707 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.634708 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.635340 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.635341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.636090 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.636092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.636633 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.636634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.636709 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.636712 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.636787 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.636826 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":63,"threads_started":1}
I20260812 00:05:42.637140 29162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.634191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:40917 (local address 127.19.59.65:38843)
0812 00:05:42.634361 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.634372 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.634445 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.634745 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.634746 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.634748 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:42.634819 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.634821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.635475 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.635476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.636153 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.636155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.636704 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.636705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.636780 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.636783 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.636856 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.636903 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":3,"thread_start_us":61,"threads_started":1}
I20260812 00:05:42.636982 29163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.634351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:38843 (local address 127.19.59.66:40917)
0812 00:05:42.634609 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.634611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.634617 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:05:42.634641 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.634642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.634650 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.634739 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:42.634893 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.635383 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.636242 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.636620 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.636705 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.636713 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.636864 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.636904 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":57,"threads_started":1}
I20260812 00:05:42.637182 28984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a11b826049a45aca1a863fc287d3cfb" candidate_uuid: "6322906eb3c04fdcb1efa0f80b56135b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9620f9227e884c229db84a770e4ffae2" is_pre_election: true
I20260812 00:05:42.637300 28984 raft_consensus.cc:2454] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6322906eb3c04fdcb1efa0f80b56135b in term 0.
I20260812 00:05:42.637504 28581 leader_election.cc:302] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6322906eb3c04fdcb1efa0f80b56135b, 9620f9227e884c229db84a770e4ffae2; no voters:
I20260812 00:05:42.637542 28817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a11b826049a45aca1a863fc287d3cfb" candidate_uuid: "6322906eb3c04fdcb1efa0f80b56135b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f57eace3355b4bb39ca07ea722340afe" is_pre_election: true
I20260812 00:05:42.637627 28817 raft_consensus.cc:2454] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6322906eb3c04fdcb1efa0f80b56135b in term 0.
I20260812 00:05:42.637673 29075 raft_consensus.cc:2781] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:42.637730 29075 raft_consensus.cc:482] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:42.637753 29075 raft_consensus.cc:3037] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:42.638460 29075 raft_consensus.cc:504] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.638561 29075 leader_election.cc:288] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [CANDIDATE]: Term 1 election: Requested vote from peers f57eace3355b4bb39ca07ea722340afe (127.19.59.66:40917), 9620f9227e884c229db84a770e4ffae2 (127.19.59.67:44127)
I20260812 00:05:42.638706 28817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a11b826049a45aca1a863fc287d3cfb" candidate_uuid: "6322906eb3c04fdcb1efa0f80b56135b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f57eace3355b4bb39ca07ea722340afe"
I20260812 00:05:42.638782 28817 raft_consensus.cc:3037] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:42.639427 28817 raft_consensus.cc:2454] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6322906eb3c04fdcb1efa0f80b56135b in term 1.
I20260812 00:05:42.639544 28984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a11b826049a45aca1a863fc287d3cfb" candidate_uuid: "6322906eb3c04fdcb1efa0f80b56135b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9620f9227e884c229db84a770e4ffae2"
I20260812 00:05:42.639591 28579 leader_election.cc:302] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6322906eb3c04fdcb1efa0f80b56135b, f57eace3355b4bb39ca07ea722340afe; no voters:
I20260812 00:05:42.639634 28984 raft_consensus.cc:3037] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:42.639674 29075 raft_consensus.cc:2781] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:42.639776 29075 raft_consensus.cc:686] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [term 1 LEADER]: Becoming Leader. State: Replica: 6322906eb3c04fdcb1efa0f80b56135b, State: Running, Role: LEADER
I20260812 00:05:42.639842 29075 consensus_queue.cc:237] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } }
I20260812 00:05:42.640451 28984 raft_consensus.cc:2454] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6322906eb3c04fdcb1efa0f80b56135b in term 1.
I20260812 00:05:42.641060 28474 catalog_manager.cc:5495] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65). New cstate: current_term: 1 leader_uuid: "6322906eb3c04fdcb1efa0f80b56135b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6322906eb3c04fdcb1efa0f80b56135b" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 43929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 } health_report { overall_health: UNKNOWN } } }
I20260812 00:05:42.661958 29167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.659491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39916 (local address 127.19.59.65:43929)
0812 00:05:42.659674 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.659676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.659681 (+ 5us) server_negotiation.cc:407] Connection header received
0812 00:05:42.659713 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.659714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.659731 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.659815 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:42.659931 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.660429 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.661163 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.661379 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.661465 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.661589 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:42.661700 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:42.661779 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.661821 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.661844 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":105,"threads_started":1}
I20260812 00:05:42.666682 29163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.664456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:48857 (local address 127.19.59.66:40917)
0812 00:05:42.664532 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.664534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.664645 (+ 111us) server_negotiation.cc:407] Connection header received
0812 00:05:42.664682 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.664683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.664694 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.664742 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:42.664845 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.665285 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.666098 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.666283 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.666332 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.666499 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:42.666522 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:42.666557 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.666615 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.666632 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 00:05:42.666704 29170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.664354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:40917 (local address 127.19.59.65:48857)
0812 00:05:42.664583 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.664592 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.664642 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.664755 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.664756 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.664757 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:05:42.664809 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.664810 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.665370 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.665371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.666023 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.666026 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.666363 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.666364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.666413 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.666425 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:05:42.666579 (+ 154us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:05:42.666581 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.666612 (+ 31us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.666640 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":124,"threads_started":1}
I20260812 00:05:42.668777 28984 raft_consensus.cc:1261] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Refusing update from remote peer 6322906eb3c04fdcb1efa0f80b56135b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:42.668805 28817 raft_consensus.cc:1261] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Refusing update from remote peer 6322906eb3c04fdcb1efa0f80b56135b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:42.669178 29164 consensus_queue.cc:1035] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f57eace3355b4bb39ca07ea722340afe" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 40917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:42.669312 29075 consensus_queue.cc:1035] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9620f9227e884c229db84a770e4ffae2" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:42.676862 29167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.674457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:41711 (local address 127.19.59.65:43929)
0812 00:05:42.674512 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.674514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.674646 (+ 132us) server_negotiation.cc:407] Connection header received
0812 00:05:42.674671 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.674672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.674683 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.674731 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:42.674859 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.675321 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.676084 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.676349 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.676419 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.676623 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:42.676658 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:42.676711 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.676772 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.676792 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:05:42.676889 29178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.674368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:43929 (local address 127.19.59.66:41711)
0812 00:05:42.674523 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.674534 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.674595 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.674748 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.674749 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.674750 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:05:42.674797 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.674799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.675423 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.675424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.675996 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.675998 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.676433 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.676434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.676548 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.676553 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:05:42.676711 (+ 158us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:05:42.676714 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.676767 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.676810 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":108,"threads_started":1}
I20260812 00:05:42.686805 28474 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:42.686928 28474 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:42.687645 28474 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8aed2b178a9f4a118b7e3ed3de02784d: Sending DeleteTablet for 3 replicas of tablet 5a11b826049a45aca1a863fc287d3cfb
I20260812 00:05:42.687980 28632 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a11b826049a45aca1a863fc287d3cfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:42 UTC) from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:39914
I20260812 00:05:42.687966 28962 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a11b826049a45aca1a863fc287d3cfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:42 UTC) from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:37814
I20260812 00:05:42.688088 29094 tablet_replica.cc:330] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b: stopping tablet replica
I20260812 00:05:42.688146 29094 raft_consensus.cc:2229] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:42.688164 29096 tablet_replica.cc:330] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2: stopping tablet replica
I20260812 00:05:42.688221 29096 raft_consensus.cc:2229] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:42.688227 29094 raft_consensus.cc:2258] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:42.688262 29096 raft_consensus.cc:2258] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:42.688498 28796 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a11b826049a45aca1a863fc287d3cfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:42 UTC) from {username='oryx', principal='oryx/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:40132
I20260812 00:05:42.688537 29094 ts_tablet_manager.cc:1905] T 5a11b826049a45aca1a863fc287d3cfb P 6322906eb3c04fdcb1efa0f80b56135b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:42.688594 29095 tablet_replica.cc:330] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe: stopping tablet replica
I20260812 00:05:42.688647 29095 raft_consensus.cc:2229] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:42.688688 29095 raft_consensus.cc:2258] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:42.689055 29095 ts_tablet_manager.cc:1905] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:42.690095 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 28558
I20260812 00:05:42.693858 29096 ts_tablet_manager.cc:1905] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:42.695232 29095 ts_tablet_manager.cc:1918] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:05:42.695307 29095 log.cc:1196] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/5a11b826049a45aca1a863fc287d3cfb
I20260812 00:05:42.695353 29096 ts_tablet_manager.cc:1918] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:05:42.695403 29096 log.cc:1196] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/5a11b826049a45aca1a863fc287d3cfb
I20260812 00:05:42.695550 29095 ts_tablet_manager.cc:1939] T 5a11b826049a45aca1a863fc287d3cfb P f57eace3355b4bb39ca07ea722340afe: Deleting consensus metadata
I20260812 00:05:42.695608 29096 ts_tablet_manager.cc:1939] T 5a11b826049a45aca1a863fc287d3cfb P 9620f9227e884c229db84a770e4ffae2: Deleting consensus metadata
I20260812 00:05:42.695923 28461 catalog_manager.cc:4841] TS f57eace3355b4bb39ca07ea722340afe (127.19.59.66:40917): tablet 5a11b826049a45aca1a863fc287d3cfb (table test-table [id=5bfb3141566a46b5b1a730b696f70c8c]) successfully deleted
I20260812 00:05:42.695936 28463 catalog_manager.cc:4841] TS 9620f9227e884c229db84a770e4ffae2 (127.19.59.67:44127): tablet 5a11b826049a45aca1a863fc287d3cfb (table test-table [id=5bfb3141566a46b5b1a730b696f70c8c]) successfully deleted
W20260812 00:05:42.699942 28461 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:43929 (error 108)
I20260812 00:05:42.700286 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 28722
I20260812 00:05:42.701748 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.700355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:43929 (local address 127.0.0.1:39930)
0812 00:05:42.701642 (+ 1287us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.701696 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:43929: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1265,"thread_start_us":51,"threads_started":1}
W20260812 00:05:42.702371 28461 catalog_manager.cc:4584] TS 6322906eb3c04fdcb1efa0f80b56135b (127.19.59.65:43929): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5a11b826049a45aca1a863fc287d3cfb: Network error: Client connection negotiation failed: client connection to 127.19.59.65:43929: connect: Connection refused (error 111)
I20260812 00:05:42.708618 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 28881
I20260812 00:05:42.716593 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 28441
2026-08-12T00:05:42Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2770 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:42 dist-test-slave-6nmv krb5kdc[29186](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:42 dist-test-slave-6nmv krb5kdc[29186](info): set up 2 sockets
Aug 12 00:05:42 dist-test-slave-6nmv krb5kdc[29186](info): commencing operation
krb5kdc: starting...
W20260812 00:05:43.769891 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.029s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:05:43 dist-test-slave-6nmv krb5kdc[29186](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493143, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:05:43.882685 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:34493
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:34493
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:43.963068 29201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:43.963304 29201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:43.963342 29201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:43.964496 29201 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:43.964560 29201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:43.964586 29201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:43.964619 29201 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:43.964643 29201 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:43.966156 29201 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:34493
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:34493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:43.966408 29201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:43.966629 29201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:43.971179 29207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:43.971192 29208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:43.971405 29201 server_base.cc:1034] running on GCE node
W20260812 00:05:43.971192 29210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:43.971778 29201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:43.972141 29201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:43.973316 29201 hybrid_clock.cc:648] HybridClock initialized: now 1786493143973292 us; error 36 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T00:05:43Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1259 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:44 dist-test-slave-6nmv krb5kdc[29216](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:44 dist-test-slave-6nmv krb5kdc[29216](info): set up 2 sockets
Aug 12 00:05:44 dist-test-slave-6nmv krb5kdc[29216](info): commencing operation
krb5kdc: starting...
W20260812 00:05:45.044193 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:05:45 dist-test-slave-6nmv krb5kdc[29216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:05:45.158902 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:44941
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:44941
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:45.235668 29229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:45.235893 29229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:45.235929 29229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:45.237022 29229 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:45.237092 29229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:45.237118 29229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:45.237138 29229 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:45.237178 29229 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:45.238701 29229 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:44941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:44941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:45.238958 29229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:45.239200 29229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:45.243764 29235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.243764 29237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.243767 29234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:45.244210 29229 server_base.cc:1034] running on GCE node
I20260812 00:05:45.244493 29229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:45.244766 29229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:45.245868 29229 hybrid_clock.cc:648] HybridClock initialized: now 1786493145245859 us; error 34 us; skew 500 ppm
Aug 12 00:05:45 dist-test-slave-6nmv krb5kdc[29216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493145, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:45.252408 29229 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:05:45.252884 29229 webserver.cc:460] Webserver started at http://127.19.59.126:38455/ using document root <none> and password file <none>
I20260812 00:05:45.253141 29229 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:45.253203 29229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:45.253334 29229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:45.254395 29229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "3ab89376eb0a49b6bc85c34d6859ced3"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "50a3055d20006b1739cce4c7e83ff26d"
server_key_iv: "8daa44eed2dde4c7437f8b4df38bc070"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.254746 29229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "3ab89376eb0a49b6bc85c34d6859ced3"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "50a3055d20006b1739cce4c7e83ff26d"
server_key_iv: "8daa44eed2dde4c7437f8b4df38bc070"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.256034 29229 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:45.256775 29244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.256965 29229 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:45.257077 29229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "3ab89376eb0a49b6bc85c34d6859ced3"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "50a3055d20006b1739cce4c7e83ff26d"
server_key_iv: "8daa44eed2dde4c7437f8b4df38bc070"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.257143 29229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:45.274120 29229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:45.276067 29229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:45.276244 29229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:45.280596 29229 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:44941
I20260812 00:05:45.280654 29305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:44941 every 8 connection(s)
I20260812 00:05:45.281050 29229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:45.282037 29306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:45.283406 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 29229
I20260812 00:05:45.283510 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:05:45.283699 19693 external_mini_cluster.cc:1428] Setting key 7a892f770a2a413d13e6ceedc215d847
I20260812 00:05:45.284672 29306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3: Bootstrap starting.
I20260812 00:05:45.285383 29306 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:45.285722 29306 log.cc:824] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:45.286492 29306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3: No bootstrap required, opened a new log
I20260812 00:05:45.288681 29306 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 44941 } }
I20260812 00:05:45.288839 29306 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:45.288863 29306 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ab89376eb0a49b6bc85c34d6859ced3, State: Initialized, Role: FOLLOWER
I20260812 00:05:45.289021 29306 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 44941 } }
I20260812 00:05:45.289101 29306 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:45.289126 29306 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:45.289165 29306 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:45.289721 29306 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 44941 } }
I20260812 00:05:45.289855 29306 leader_election.cc:302] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ab89376eb0a49b6bc85c34d6859ced3; no voters:
I20260812 00:05:45.290059 29306 leader_election.cc:288] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:45.290086 29311 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:45.290198 29311 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ab89376eb0a49b6bc85c34d6859ced3, State: Running, Role: LEADER
I20260812 00:05:45.290278 29311 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 44941 } }
I20260812 00:05:45.290347 29306 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:45.290591 29311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 44941 } } }
I20260812 00:05:45.290727 29311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [sys.catalog]: This master's current role is: LEADER
Aug 12 00:05:45 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:45.290925 29311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ab89376eb0a49b6bc85c34d6859ced3. Latest consensus state: current_term: 1 leader_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 44941 } } }
I20260812 00:05:45.291000 29311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:45.291374 29319 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:45.291918 29319 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:45.293597 29319 catalog_manager.cc:1347] Generated new cluster ID: 6c061411f83345499a546604ccf34320
I20260812 00:05:45.293653 29319 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:45.295138 29309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.284251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44160 (local address 127.19.59.126:44941)
0812 00:05:45.284414 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.284422 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.284449 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:05:45.284875 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.284882 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.284946 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.285061 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:45.285972 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.286982 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.288041 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.288413 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.288490 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.291399 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:45.291403 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:45.291403 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:45.291416 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:45.293481 (+ 2065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:45.293902 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:45.293905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:45.293905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:45.294019 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:45.294272 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:45.294273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:45.294273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:45.294563 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:45.294694 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.294823 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.294946 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":76,"threads_started":1}
I20260812 00:05:45.309126 29319 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:45.309576 29319 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:45.314182 29319 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3: Generated new TSK 0
I20260812 00:05:45.314334 29319 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:05:45.346139 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:44941
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:45.424355 29336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:45.424561 29336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:45.424585 29336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:45.425647 29336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:45.425678 29336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:45.425701 29336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:05:45.426936 29336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:44941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:45.427109 29336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:45.427265 29336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:45.432137 29343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.432132 29341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.432163 29345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:45.432427 29336 server_base.cc:1034] running on GCE node
I20260812 00:05:45.432626 29336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:45.432871 29336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:45.434032 29336 hybrid_clock.cc:648] HybridClock initialized: now 1786493145434008 us; error 39 us; skew 500 ppm
Aug 12 00:05:45 dist-test-slave-6nmv krb5kdc[29216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493145, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:45.436498 29336 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:05:45.436873 29336 webserver.cc:460] Webserver started at http://127.19.59.65:42117/ using document root <none> and password file <none>
I20260812 00:05:45.437104 29336 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:45.437147 29336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:45.437289 29336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:45.438382 29336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "1898a31a733f4b579597bf4fb912a804"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "df9614e36171f76170c3a96182baa413"
server_key_iv: "9e3298ecd791ea01a393bc86cc35111a"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.438735 29336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "1898a31a733f4b579597bf4fb912a804"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "df9614e36171f76170c3a96182baa413"
server_key_iv: "9e3298ecd791ea01a393bc86cc35111a"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.440011 29336 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:45.440737 29353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.440923 29336 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:45.441010 29336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "1898a31a733f4b579597bf4fb912a804"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "df9614e36171f76170c3a96182baa413"
server_key_iv: "9e3298ecd791ea01a393bc86cc35111a"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.441077 29336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:45.467206 29336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:45.469484 29336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:45.469635 29336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:45.469920 29336 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:45.470247 29336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:45.470278 29336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.470299 29336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:45.470338 29336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.475988 29336 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:34985
I20260812 00:05:45.476085 29482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:34985 every 8 connection(s)
I20260812 00:05:45.476378 29336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:05:45.481020 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 29336
I20260812 00:05:45.481129 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:45.481317 19693 external_mini_cluster.cc:1428] Setting key f5bc3ec94b5bdd4b5ae9834ba8908e39
Aug 12 00:05:45 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493145, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:45.485277 29309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.477126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:59339 (local address 127.19.59.126:44941)
0812 00:05:45.477197 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.477199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.477375 (+ 176us) server_negotiation.cc:407] Connection header received
0812 00:05:45.477925 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.477926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.477955 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.478021 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:45.478954 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.479420 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.480229 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.480403 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.480451 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.482565 (+ 2114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:45.482567 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:45.482567 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:45.482574 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:45.483876 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:45.484368 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:45.484369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:45.484369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:45.484421 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:45.484685 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:45.484686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:45.484686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:45.484780 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:45.484830 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.485134 (+ 304us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.485201 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 00:05:45.485564 29485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.477074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:59339)
0812 00:05:45.477237 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.477278 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.477764 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.478096 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.478099 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.478697 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:45.478872 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.478875 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.479496 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.479496 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.480161 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.480163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.480475 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.480476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.480565 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.480988 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:45.480997 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:45.482478 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:45.483952 (+ 1474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:45.483958 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:45.483960 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:45.484286 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:45.484483 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:45.484484 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:45.484484 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:45.484622 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:45.484843 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:45.484849 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:45.485002 (+ 153us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.485115 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.485297 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":89,"threads_started":1}
I20260812 00:05:45.486243 29483 heartbeater.cc:347] Connected to a master server at 127.19.59.126:44941
I20260812 00:05:45.486349 29483 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:45.486533 29483 heartbeater.cc:511] Master 127.19.59.126:44941 requested a full tablet report, sending...
I20260812 00:05:45.487015 29262 ts_manager.cc:194] Registered new tserver with Master: 1898a31a733f4b579597bf4fb912a804 (127.19.59.65:34985)
I20260812 00:05:45.487572 29262 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:59339
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:05:45.506395 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:44941
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:45.585095 29489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:45.585314 29489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:45.585335 29489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:45.586571 29489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:45.586614 29489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:45.586640 29489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:05:45.588037 29489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:44941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:45.588212 29489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:45.588387 29489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:45.593432 29497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.593442 29498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.593485 29501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:45.593539 29489 server_base.cc:1034] running on GCE node
I20260812 00:05:45.593966 29489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:45.594269 29489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:45.595449 29489 hybrid_clock.cc:648] HybridClock initialized: now 1786493145595430 us; error 30 us; skew 500 ppm
Aug 12 00:05:45 dist-test-slave-6nmv krb5kdc[29216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493145, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:45.598349 29489 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:05:45.598768 29489 webserver.cc:460] Webserver started at http://127.19.59.66:41489/ using document root <none> and password file <none>
I20260812 00:05:45.599015 29489 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:45.599085 29489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:45.599221 29489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:45.600354 29489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "d93e81441280476b9086a845b2b4260d"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "5db25818319d545ab269b500c4313aaf"
server_key_iv: "9b54d16f26885112349c9a39b6a1f8c9"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.600708 29489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "d93e81441280476b9086a845b2b4260d"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "5db25818319d545ab269b500c4313aaf"
server_key_iv: "9b54d16f26885112349c9a39b6a1f8c9"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.602104 29489 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:05:45.602900 29508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.603071 29489 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:45.603189 29489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "d93e81441280476b9086a845b2b4260d"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "5db25818319d545ab269b500c4313aaf"
server_key_iv: "9b54d16f26885112349c9a39b6a1f8c9"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.603258 29489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:45.625581 29489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:45.627753 29489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:45.627944 29489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:45.628203 29489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:45.628527 29489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:45.628583 29489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.628625 29489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:45.628650 29489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.634717 29489 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:36363
I20260812 00:05:45.634768 29653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:36363 every 8 connection(s)
I20260812 00:05:45.635092 29489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:05:45 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493145, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:45.640944 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 29489
I20260812 00:05:45.641052 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:45.641250 19693 external_mini_cluster.cc:1428] Setting key 779872321bb77e7098439f2aee1b1085
I20260812 00:05:45.644317 29309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.635839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:34969 (local address 127.19.59.126:44941)
0812 00:05:45.635922 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.635924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.636081 (+ 157us) server_negotiation.cc:407] Connection header received
0812 00:05:45.636538 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.636539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.636548 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.636601 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:45.637487 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.637986 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.638905 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.639092 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.639141 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.641350 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:45.641352 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:45.641352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:45.641360 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:45.642838 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:45.643275 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:45.643276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:45.643277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:45.643339 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:45.643606 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:45.643607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:45.643608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:45.643757 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:45.643831 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.644087 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.644197 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 00:05:45.644330 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.635781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:34969)
0812 00:05:45.635964 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.636000 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.636457 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.636651 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.636654 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.637230 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:45.637410 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.637415 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.638059 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.638060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.638833 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.638834 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.639163 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.639163 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.639270 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.639725 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:45.639733 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:45.641247 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:45.642941 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:45.642949 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:45.642951 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:45.643170 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:45.643414 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:45.643415 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:45.643415 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:45.643541 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:45.643822 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:45.643828 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:45.643947 (+ 119us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.644039 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.644177 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":94,"threads_started":1}
I20260812 00:05:45.644847 29655 heartbeater.cc:347] Connected to a master server at 127.19.59.126:44941
I20260812 00:05:45.644968 29655 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:45.645159 29655 heartbeater.cc:511] Master 127.19.59.126:44941 requested a full tablet report, sending...
I20260812 00:05:45.645532 29262 ts_manager.cc:194] Registered new tserver with Master: d93e81441280476b9086a845b2b4260d (127.19.59.66:36363)
I20260812 00:05:45.645990 29262 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:34969
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:05:45.668027 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:44941
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:45.742743 29660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:45.742924 29660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:45.742952 29660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:45.744055 29660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:45.744092 29660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:45.744117 29660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:05:45.745496 29660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:44941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:45.745707 29660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:45.745926 29660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:45.750589 29667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.750583 29669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.750602 29666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:45.751025 29660 server_base.cc:1034] running on GCE node
I20260812 00:05:45.751217 29660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:45.751385 29660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:45.752521 29660 hybrid_clock.cc:648] HybridClock initialized: now 1786493145752511 us; error 25 us; skew 500 ppm
Aug 12 00:05:45 dist-test-slave-6nmv krb5kdc[29216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493145, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:45.755185 29660 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:05:45.755620 29660 webserver.cc:460] Webserver started at http://127.19.59.67:44075/ using document root <none> and password file <none>
I20260812 00:05:45.755780 29660 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:45.755815 29660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:45.755896 29660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:45.756796 29660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "48c54dc011a74a13ad4eae337f29217e"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "d0248ce1bb9e7e1c7593e52daf34ba49"
server_key_iv: "491ffd2e50b2570d35a0d7f23d4c0c9f"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.757068 29660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "48c54dc011a74a13ad4eae337f29217e"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "d0248ce1bb9e7e1c7593e52daf34ba49"
server_key_iv: "491ffd2e50b2570d35a0d7f23d4c0c9f"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.758350 29660 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:45.759022 29676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.759277 29660 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:45.759370 29660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "48c54dc011a74a13ad4eae337f29217e"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "d0248ce1bb9e7e1c7593e52daf34ba49"
server_key_iv: "491ffd2e50b2570d35a0d7f23d4c0c9f"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.759474 29660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:45.778116 29660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:45.780418 29660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:45.780536 29660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:45.780773 29660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:45.781088 29660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:45.781142 29660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.781177 29660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:45.781224 29660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.787482 29660 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:39361
I20260812 00:05:45.787530 29807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:39361 every 8 connection(s)
I20260812 00:05:45.787842 29660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:45.792817 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 29660
I20260812 00:05:45.792969 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:45.793182 19693 external_mini_cluster.cc:1428] Setting key fa0ea6cb91b454365fb9cf07851e9063
Aug 12 00:05:45 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493145, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:05:45.797358 29309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.788566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:44675 (local address 127.19.59.126:44941)
0812 00:05:45.788650 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.788652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.788804 (+ 152us) server_negotiation.cc:407] Connection header received
0812 00:05:45.789292 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.789293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.789302 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.789347 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:45.790408 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.790997 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.792052 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.792243 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.792309 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.794907 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:45.794909 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:45.794909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:45.794916 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:45.796192 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:45.796551 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:45.796551 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:45.796552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:45.796603 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:45.796809 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:45.796809 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:45.796809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:45.796904 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:45.796953 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.797215 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.797293 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 00:05:45.797513 29810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.788518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:44675)
0812 00:05:45.788690 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.788724 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.789217 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.789404 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.789407 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.790085 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:45.790322 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.790328 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.791097 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.791098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.791948 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.791950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.792476 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.792477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.792587 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.793127 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:45.793135 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:45.794826 (+ 1691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:45.796263 (+ 1437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:45.796269 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:45.796271 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:45.796479 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:45.796661 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:45.796661 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:45.796662 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:45.796756 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:45.796959 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:45.796963 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:45.797072 (+ 109us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.797155 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.797273 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":90,"threads_started":1}
I20260812 00:05:45.798066 29808 heartbeater.cc:347] Connected to a master server at 127.19.59.126:44941
I20260812 00:05:45.798167 29808 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:45.798354 29808 heartbeater.cc:511] Master 127.19.59.126:44941 requested a full tablet report, sending...
I20260812 00:05:45.798758 29262 ts_manager.cc:194] Registered new tserver with Master: 48c54dc011a74a13ad4eae337f29217e (127.19.59.67:39361)
I20260812 00:05:45.799116 29262 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:44675
I20260812 00:05:45.804821 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.65.keytab.
Entry for principal oryx/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.65.keytab.
WARNING: no policy specified for oryx/127.19.59.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.66.keytab.
Entry for principal oryx/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.66.keytab.
WARNING: no policy specified for oryx/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.67.keytab.
Entry for principal oryx/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.67.keytab.
I20260812 00:05:45.873996 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 29336
I20260812 00:05:45.882126 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 29489
I20260812 00:05:45.888203 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 29660
I20260812 00:05:45.892941 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 29229
I20260812 00:05:45.899992 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:44941
--webserver_interface=127.19.59.126
--webserver_port=38455
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:44941
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:45.978920 29819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:45.979125 29819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:45.979146 29819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:45.980294 29819 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:45.980340 29819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:45.980353 29819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:45.980365 29819 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:45.980377 29819 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:45.981776 29819 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:44941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:44941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=38455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:45.982043 29819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:45.982292 29819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:45.987136 29827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:45.987195 29819 server_base.cc:1034] running on GCE node
W20260812 00:05:45.987136 29825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.987178 29824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:45.987622 29819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:45.987982 29819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:45.989158 29819 hybrid_clock.cc:648] HybridClock initialized: now 1786493145989132 us; error 38 us; skew 500 ppm
Aug 12 00:05:45 dist-test-slave-6nmv krb5kdc[29216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493145, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:45.991629 29819 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:05:45.992142 29819 webserver.cc:460] Webserver started at http://127.19.59.126:38455/ using document root <none> and password file <none>
I20260812 00:05:45.992368 29819 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:45.992462 29819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:45.993952 29819 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:45.994670 29835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.994867 29819 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:45.994957 29819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "3ab89376eb0a49b6bc85c34d6859ced3"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "50a3055d20006b1739cce4c7e83ff26d"
server_key_iv: "8daa44eed2dde4c7437f8b4df38bc070"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.995270 29819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:46.011794 29819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:46.014279 29819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:46.014454 29819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:46.018405 29819 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:44941
I20260812 00:05:46.018458 29895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:44941 every 8 connection(s)
I20260812 00:05:46.018858 29819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:46.020859 29896 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:05:46.021790 29896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3: Bootstrap starting.
I20260812 00:05:46.025918 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 29819
I20260812 00:05:46.026238 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:34985
--local_ip_for_outbound_sockets=127.19.59.65
--tserver_master_addrs=127.19.59.126:44941
--webserver_port=42117
--webserver_interface=127.19.59.65
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.59.65
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:05:46.032234 29896 log.cc:824] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:46.034582 29896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:05:46.034922 29896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3: Bootstrap complete.
I20260812 00:05:46.038607 29896 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 44941 } }
I20260812 00:05:46.038947 29896 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ab89376eb0a49b6bc85c34d6859ced3, State: Initialized, Role: FOLLOWER
I20260812 00:05:46.039168 29896 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 44941 } }
I20260812 00:05:46.039242 29896 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:46.039306 29896 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:46.039347 29896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:05:46.040777 29896 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 44941 } }
I20260812 00:05:46.040892 29896 leader_election.cc:302] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ab89376eb0a49b6bc85c34d6859ced3; no voters:
I20260812 00:05:46.041071 29896 leader_election.cc:288] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:05:46.041208 29900 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:05:46.041366 29896 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:46.041461 29900 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [term 2 LEADER]: Becoming Leader. State: Replica: 3ab89376eb0a49b6bc85c34d6859ced3, State: Running, Role: LEADER
I20260812 00:05:46.041591 29900 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 44941 } }
I20260812 00:05:46.041949 29901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 44941 } } }
I20260812 00:05:46.042016 29901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:46.042131 29901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ab89376eb0a49b6bc85c34d6859ced3. Latest consensus state: current_term: 2 leader_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab89376eb0a49b6bc85c34d6859ced3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 44941 } } }
I20260812 00:05:46.042166 29901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:46.042522 29912 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:46.043081 29912 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:46.043195 29912 catalog_manager.cc:1259] Loaded cluster ID: 6c061411f83345499a546604ccf34320
I20260812 00:05:46.043226 29912 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:46.044335 29912 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:46.044516 29912 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3ab89376eb0a49b6bc85c34d6859ced3: Loaded TSK: 0
I20260812 00:05:46.044718 29912 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:05:46.133460 29898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:46.133713 29898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:46.133754 29898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:46.135468 29898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:46.135524 29898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:46.135560 29898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:05:46.137492 29898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.65.keytab
--principal=oryx/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:34985
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=42117
--tserver_master_addrs=127.19.59.126:44941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:46.137705 29898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:46.137976 29898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:46.143143 29930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:46.143158 29932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:46.143393 29934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:46.143568 29898 server_base.cc:1034] running on GCE node
I20260812 00:05:46.143766 29898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:46.144042 29898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:46.145202 29898 hybrid_clock.cc:648] HybridClock initialized: now 1786493146145189 us; error 32 us; skew 500 ppm
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493146, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:46.148010 29898 init.cc:377] Logged in from keytab as oryx/127.19.59.65@KRBTEST.COM (short username oryx)
I20260812 00:05:46.148531 29898 webserver.cc:460] Webserver started at http://127.19.59.65:42117/ using document root <none> and password file <none>
I20260812 00:05:46.148805 29898 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:46.148895 29898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:46.150786 29898 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:05:46.151492 29941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:46.151721 29898 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:46.151808 29898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "1898a31a733f4b579597bf4fb912a804"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "df9614e36171f76170c3a96182baa413"
server_key_iv: "9e3298ecd791ea01a393bc86cc35111a"
server_key_version: "encryptionkey@0"
I20260812 00:05:46.152268 29898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:46.163007 29898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:46.165539 29898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:46.165699 29898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:46.165988 29898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:46.166335 29898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:46.166388 29898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:46.166419 29898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:46.166438 29898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:46.174217 29898 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:34985
I20260812 00:05:46.174310 30073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:34985 every 8 connection(s)
I20260812 00:05:46.174683 29898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:05:46.175088 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 29898
I20260812 00:05:46.175448 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:36363
--local_ip_for_outbound_sockets=127.19.59.66
--tserver_master_addrs=127.19.59.126:44941
--webserver_port=41489
--webserver_interface=127.19.59.66
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.59.66
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:46.188167 30077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:46.175645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:35841)
0812 00:05:46.177416 (+ 1771us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:46.177465 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:46.178290 (+ 825us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:46.178779 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:46.178783 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:46.179632 (+ 849us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:46.179924 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.179931 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.181754 (+ 1823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.181756 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.183099 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.183102 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.183907 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.183908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.184072 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.184773 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:46.184785 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:46.187925 (+ 3140us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1718,"thread_start_us":92,"threads_started":1}
W20260812 00:05:46.188438 30078 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:46.175727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:35841 (local address 127.19.59.126:44941)
0812 00:05:46.175951 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:46.175961 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:46.177609 (+ 1648us) server_negotiation.cc:407] Connection header received
0812 00:05:46.178505 (+ 896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:46.178512 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:46.178571 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:46.178721 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:46.180085 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.181632 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.183200 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.183809 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.183915 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.188095 (+ 4180us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:35841: BlockingRecv error: recv got EOF from 127.19.59.65:35841 (error 108)
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":96,"threads_started":1}
W20260812 00:05:46.188895 30074 heartbeater.cc:644] Failed to heartbeat to 127.19.59.126:44941 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.59.126:44941: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:46.194450 30077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:46.189140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:46275)
0812 00:05:46.189261 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:46.189271 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:46.189316 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:46.189480 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:46.189481 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:46.189632 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:46.189687 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.189689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.190509 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.190509 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.191288 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.191290 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.191790 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.191791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.191861 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.192388 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:46.192394 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:46.194372 (+ 1978us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103}
W20260812 00:05:46.194540 30078 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:46.189218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:46275 (local address 127.19.59.126:44941)
0812 00:05:46.189271 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:46.189273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:46.189305 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:05:46.189387 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:46.189388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:46.189401 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:46.189463 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:46.189766 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.190414 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.191408 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.191699 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.191783 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.194471 (+ 2688us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:46275: BlockingRecv error: recv got EOF from 127.19.59.65:46275 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:46.200227 30077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:46.194914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:50405)
0812 00:05:46.195053 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:46.195063 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:46.195138 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:46.195319 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:46.195320 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:46.195503 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:46.195542 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.195544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.196406 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.196407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.197174 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.197176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.197629 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.197630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.197687 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.198164 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:46.198170 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:46.200143 (+ 1973us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
W20260812 00:05:46.200302 30078 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:46.194996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:50405 (local address 127.19.59.126:44941)
0812 00:05:46.195035 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:46.195037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:46.195110 (+ 73us) server_negotiation.cc:407] Connection header received
0812 00:05:46.195213 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:46.195214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:46.195226 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:46.195293 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:46.195635 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.196314 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.197274 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.197537 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.197606 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.200246 (+ 2640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:50405: BlockingRecv error: recv got EOF from 127.19.59.65:50405 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 00:05:46.200665 30074 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:05:46.262878 30079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:46.263125 30079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:46.263162 30079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:46.264230 30079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:46.264299 30079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:46.264346 30079 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:05:46.265758 30079 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.66.keytab
--principal=oryx/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:36363
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=41489
--tserver_master_addrs=127.19.59.126:44941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:46.266049 30079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:46.266269 30079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:46.270691 30087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:46.270684 30086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:46.270695 30089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:46.270956 30079 server_base.cc:1034] running on GCE node
I20260812 00:05:46.271162 30079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:46.271395 30079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:46.272578 30079 hybrid_clock.cc:648] HybridClock initialized: now 1786493146272570 us; error 26 us; skew 500 ppm
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493146, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:46.275169 30079 init.cc:377] Logged in from keytab as oryx/127.19.59.66@KRBTEST.COM (short username oryx)
I20260812 00:05:46.275593 30079 webserver.cc:460] Webserver started at http://127.19.59.66:41489/ using document root <none> and password file <none>
I20260812 00:05:46.275764 30079 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:46.275811 30079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:46.276940 30079 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:46.277506 30099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:46.277657 30079 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:46.277730 30079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "d93e81441280476b9086a845b2b4260d"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "5db25818319d545ab269b500c4313aaf"
server_key_iv: "9b54d16f26885112349c9a39b6a1f8c9"
server_key_version: "encryptionkey@0"
I20260812 00:05:46.278076 30079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:46.291182 30079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:46.293377 30079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:46.293486 30079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:46.293646 30079 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:46.293973 30079 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:46.294024 30079 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:46.294057 30079 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:46.294083 30079 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:46.299965 30079 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:36363
I20260812 00:05:46.300045 30234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:36363 every 8 connection(s)
I20260812 00:05:46.300360 30079 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:46.301851 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 30079
I20260812 00:05:46.302138 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:39361
--local_ip_for_outbound_sockets=127.19.59.67
--tserver_master_addrs=127.19.59.126:44941
--webserver_port=44075
--webserver_interface=127.19.59.67
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.59.67
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:05:46.308486 30078 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:46.301067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:44415 (local address 127.19.59.126:44941)
0812 00:05:46.301112 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:46.301114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:46.301322 (+ 208us) server_negotiation.cc:407] Connection header received
0812 00:05:46.301871 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:46.301872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:46.301892 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:46.301984 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:46.302928 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.303619 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.305086 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.305297 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.305387 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.308440 (+ 3053us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:44415: BlockingRecv error: recv got EOF from 127.19.59.66:44415 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:05:46.308565 30237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:46.301066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:44415)
0812 00:05:46.301210 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:46.301240 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:46.301755 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:46.302089 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:46.302093 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:46.302676 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:46.302836 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.302840 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.303721 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.303722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.304994 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.304996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.305394 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.305395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.305514 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.305969 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:46.305976 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:46.308352 (+ 2376us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":75,"threads_started":1}
W20260812 00:05:46.308795 30235 heartbeater.cc:644] Failed to heartbeat to 127.19.59.126:44941 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.59.126:44941: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:46.313318 30237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:46.309031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:41011)
0812 00:05:46.309073 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:46.309088 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:46.309136 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:46.309266 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:46.309266 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:46.309393 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:46.309439 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.309440 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.310094 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.310095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.310541 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.310542 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.310868 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.310869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.310934 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.311323 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:46.311328 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:46.313255 (+ 1927us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 00:05:46.313417 30078 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:46.309086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:41011 (local address 127.19.59.126:44941)
0812 00:05:46.309147 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:46.309149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:46.309157 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:46.309182 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:46.309183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:46.309191 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:46.309262 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:46.309523 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.310026 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.310623 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.310790 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.310866 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.313338 (+ 2472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:41011: BlockingRecv error: recv got EOF from 127.19.59.66:41011 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:46.318069 30237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:46.313745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:44039)
0812 00:05:46.313851 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:46.313862 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:46.313904 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:46.314011 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:46.314012 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:46.314167 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:46.314196 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.314197 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.314747 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.314748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.315548 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.315549 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.315843 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.315844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.315895 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.316216 (+ 321us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:46.316221 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:46.318002 (+ 1781us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":92}
W20260812 00:05:46.318120 30078 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:46.313800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:44039 (local address 127.19.59.126:44941)
0812 00:05:46.313880 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:46.313882 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:46.313901 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:05:46.313952 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:46.313952 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:46.313959 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:46.313998 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:46.314256 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.314678 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.315622 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.315780 (+ 158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.315826 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.318063 (+ 2237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:44039: BlockingRecv error: recv got EOF from 127.19.59.66:44039 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260812 00:05:46.318177 30235 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:05:46.384939 30238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:46.385159 30238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:46.385198 30238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:46.386341 30238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:46.386406 30238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:46.386479 30238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:05:46.387869 30238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/krb5kdc/oryx_127.19.59.67.keytab
--principal=oryx/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:39361
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=44075
--tserver_master_addrs=127.19.59.126:44941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:05:46.388110 30238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:46.388320 30238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:46.393369 30247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:46.393456 30244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:46.393455 30245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:46.393517 30238 server_base.cc:1034] running on GCE node
I20260812 00:05:46.393795 30238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:46.394106 30238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:46.395249 30238 hybrid_clock.cc:648] HybridClock initialized: now 1786493146395233 us; error 33 us; skew 500 ppm
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493146, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:46.397956 30238 init.cc:377] Logged in from keytab as oryx/127.19.59.67@KRBTEST.COM (short username oryx)
I20260812 00:05:46.398336 30238 webserver.cc:460] Webserver started at http://127.19.59.67:44075/ using document root <none> and password file <none>
I20260812 00:05:46.398581 30238 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:46.398641 30238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:46.399926 30238 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:46.400472 30254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:46.400660 30238 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:46.400743 30238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "48c54dc011a74a13ad4eae337f29217e"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-6nmv"
server_key: "d0248ce1bb9e7e1c7593e52daf34ba49"
server_key_iv: "491ffd2e50b2570d35a0d7f23d4c0c9f"
server_key_version: "encryptionkey@0"
I20260812 00:05:46.401036 30238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:46.417560 30238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:46.419625 30238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:46.419721 30238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:46.419854 30238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:46.420133 30238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:46.420166 30238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:46.420184 30238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:46.420229 30238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:46.425665 30238 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:39361
I20260812 00:05:46.425734 30391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:39361 every 8 connection(s)
I20260812 00:05:46.426067 30238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:46.427768 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 30238
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:05:46.433925 30078 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:46.426759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:43953 (local address 127.19.59.126:44941)
0812 00:05:46.426835 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:46.426837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:46.427000 (+ 163us) server_negotiation.cc:407] Connection header received
0812 00:05:46.427412 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:46.427413 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:46.427423 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:46.427467 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:46.428667 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.429411 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.430623 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.430793 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.430861 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.433857 (+ 2996us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:43953: BlockingRecv error: recv got EOF from 127.19.59.67:43953 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 00:05:46.433940 30394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:46.426727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:43953)
0812 00:05:46.426892 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:46.426922 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:46.427330 (+ 408us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:46.427530 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:46.427533 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:46.428304 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:46.428575 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.428581 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.429505 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.429506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.430530 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.430534 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.430916 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.430917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.431048 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.431499 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:46.431508 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:46.433744 (+ 2236us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":96,"threads_started":1}
W20260812 00:05:46.434345 30392 heartbeater.cc:644] Failed to heartbeat to 127.19.59.126:44941 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.59.126:44941: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
I20260812 00:05:46.436465 30395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:46.428350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44176 (local address 127.19.59.126:44941)
0812 00:05:46.428506 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:46.428508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:46.429100 (+ 592us) server_negotiation.cc:407] Connection header received
0812 00:05:46.429184 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:46.429185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:46.429195 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:46.429287 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:46.430027 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.430468 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.431552 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.431745 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.431795 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.433109 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:46.433112 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:46.433113 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:46.433123 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:46.435069 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:46.435439 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:46.435442 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:46.435442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:46.435544 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:46.435755 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:46.435756 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:46.435757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:46.435994 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:46.436135 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:46.436240 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 00:05:46.436354 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":95,"threads_started":1}
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:46.438552 30394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:46.434593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:35257)
0812 00:05:46.434642 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:46.434652 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:46.434690 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:46.434801 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:46.434802 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:46.434941 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:46.434980 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.434982 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.435585 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.435586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.436082 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.436083 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.436451 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.436452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.436549 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.436871 (+ 322us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:46.436875 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:46.438515 (+ 1640us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 00:05:46.438653 30078 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:46.434651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:35257 (local address 127.19.59.126:44941)
0812 00:05:46.434690 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:46.434692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:46.434701 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:46.434744 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:46.434744 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:46.434753 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:46.434800 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:46.435064 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.435507 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.436164 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.436357 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.436449 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.438587 (+ 2138us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:35257: BlockingRecv error: recv got EOF from 127.19.59.67:35257 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:46 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:46.442408 30394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:46.438797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:45961)
0812 00:05:46.438826 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:46.438836 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:46.438871 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:46.438978 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:46.438979 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:46.439089 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:46.439109 (+ 20us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.439110 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.439649 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.439650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.440086 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:46.440087 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.440405 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.440406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:46.440453 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.440814 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:46.440829 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:46.442321 (+ 1492us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":15}
W20260812 00:05:46.442443 30078 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:46.438852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:45961 (local address 127.19.59.126:44941)
0812 00:05:46.438888 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:46.438889 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:46.438896 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:46.438915 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:46.438916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:46.438923 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:46.438975 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:46.439180 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.439578 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.440163 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:46.440329 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:46.440403 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:46.442394 (+ 1991us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:45961: BlockingRecv error: recv got EOF from 127.19.59.67:45961 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 00:05:46.442528 30392 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 00:05:47 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:47 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:47.205906 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.201067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:41671)
0812 00:05:47.201227 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:47.201239 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:47.201300 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:47.201469 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:47.201470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:47.201651 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:47.201698 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.201700 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.202404 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.202405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.203013 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.203015 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.203410 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.203411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.203476 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.203952 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:47.203959 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:47.205792 (+ 1833us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":85,"threads_started":1}
W20260812 00:05:47.206015 30398 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:47.201150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:41671 (local address 127.19.59.126:44941)
0812 00:05:47.201266 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:47.201269 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:47.201283 (+ 14us) server_negotiation.cc:407] Connection header received
0812 00:05:47.201370 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:47.201371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:47.201384 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:47.201457 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:47.201789 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.202321 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.203125 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.203329 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.203400 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.205918 (+ 2518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:41671: BlockingRecv error: recv got EOF from 127.19.59.65:41671 (error 108)
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":53,"threads_started":1}
Aug 12 00:05:47 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:47 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:47.323613 30399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.318716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:50949)
0812 00:05:47.318905 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:47.318918 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:47.319010 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:47.319165 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:47.319166 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:47.319353 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:47.319401 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.319402 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.320167 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.320169 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.320703 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.320705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.321065 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.321066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.321134 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.321632 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:47.321637 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:47.323545 (+ 1908us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":103,"threads_started":1}
W20260812 00:05:47.323679 30398 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:47.318821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:50949 (local address 127.19.59.126:44941)
0812 00:05:47.318910 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:47.318913 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:47.318991 (+ 78us) server_negotiation.cc:407] Connection header received
0812 00:05:47.319086 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:47.319087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:47.319100 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:47.319157 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:47.319482 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.320071 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.320792 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.320988 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.321065 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.323634 (+ 2569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:50949: BlockingRecv error: recv got EOF from 127.19.59.66:50949 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 00:05:47 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:47 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:47.447623 30400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.442855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:42255)
0812 00:05:47.443026 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:47.443039 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:47.443129 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:47.443288 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:47.443288 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:47.443471 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:47.443519 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.443521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.444173 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.444174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.444747 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.444749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.445118 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.445119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.445179 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.445698 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:47.445705 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:47.447512 (+ 1807us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":78,"threads_started":1}
W20260812 00:05:47.447676 30398 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:47.442956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:42255 (local address 127.19.59.126:44941)
0812 00:05:47.443027 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:47.443029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:47.443112 (+ 83us) server_negotiation.cc:407] Connection header received
0812 00:05:47.443182 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:47.443183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:47.443198 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:47.443278 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:47.443602 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.444092 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.444837 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.445040 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.445120 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.447607 (+ 2487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:42255: BlockingRecv error: recv got EOF from 127.19.59.67:42255 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 12 00:05:48 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:48 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:48.211244 30402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.206355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:37951)
0812 00:05:48.206519 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:48.206530 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:48.206584 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:48.206717 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:48.206718 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:48.206902 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:48.206964 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.206965 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.207603 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.207604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.208110 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.208112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.208446 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.208447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.208487 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.208997 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:48.209001 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:48.211188 (+ 2187us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
W20260812 00:05:48.211315 30403 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:48.206437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:37951 (local address 127.19.59.126:44941)
0812 00:05:48.206595 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.206597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.206605 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:48.206627 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.206628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.206639 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.206699 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:48.207034 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.207539 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.208186 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.208378 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.208432 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.211265 (+ 2833us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:37951: BlockingRecv error: recv got EOF from 127.19.59.65:37951 (error 108)
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":101,"threads_started":1}
Aug 12 00:05:48 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:48 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:48.329005 30404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.324102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:45047)
0812 00:05:48.324281 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:48.324294 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:48.324408 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:48.324579 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:48.324581 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:48.324769 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:48.324825 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.324827 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.325499 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.325500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.326043 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.326045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.326349 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.326349 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.326402 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.326961 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:48.326965 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:48.328902 (+ 1937us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":77,"threads_started":1}
W20260812 00:05:48.329057 30403 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:48.324285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:45047 (local address 127.19.59.126:44941)
0812 00:05:48.324397 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.324399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.324408 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:48.324464 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.324465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.324475 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.324525 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:48.324907 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.325406 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.326114 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.326284 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.326334 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.328994 (+ 2660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:45047: BlockingRecv error: recv got EOF from 127.19.59.66:45047 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 00:05:48 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:48 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:48.452214 30405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.448098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:38007)
0812 00:05:48.448250 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:48.448262 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:48.448309 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:48.448425 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:48.448426 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:48.448582 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:48.448628 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.448629 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.449222 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.449223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.449696 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.449697 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.450032 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.450033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.450073 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.450476 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:48.450479 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:48.452158 (+ 1679us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":76,"threads_started":1}
W20260812 00:05:48.452392 30403 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:48.448230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:38007 (local address 127.19.59.126:44941)
0812 00:05:48.448290 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.448292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.448315 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:05:48.448348 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.448349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.448368 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.448410 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:48.448693 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.449157 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.449767 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.449964 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.450017 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.452285 (+ 2268us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:38007: BlockingRecv error: recv got EOF from 127.19.59.67:38007 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 00:05:49 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:49 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:49.216584 30407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:49.211759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:49029)
0812 00:05:49.211932 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:49.211945 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:49.212009 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:49.212140 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:49.212141 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:49.212312 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:49.212361 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:49.212362 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:49.213008 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:49.213009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:49.213501 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:49.213502 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:49.214025 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:49.214026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:49.214093 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:49.214662 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:49.214670 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:49.216526 (+ 1856us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":74,"threads_started":1}
W20260812 00:05:49.216785 30409 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:49.211826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:49029 (local address 127.19.59.126:44941)
0812 00:05:49.211987 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:49.211989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:49.211997 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:49.212062 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:49.212063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:49.212074 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:49.212124 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:49.212433 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:49.212938 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:49.213566 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:49.213929 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:49.213998 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:49.216700 (+ 2702us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:49029: BlockingRecv error: recv got EOF from 127.19.59.65:49029 (error 108)
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":97,"threads_started":1}
Aug 12 00:05:49 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:49 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:49.334337 30410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:49.329509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:54505)
0812 00:05:49.329657 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:49.329668 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:49.329736 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:49.329892 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:49.329893 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:49.330070 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:49.330123 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:49.330125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:49.330708 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:49.330709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:49.331237 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:49.331239 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:49.331567 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:49.331568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:49.331622 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:49.332091 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:49.332095 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:49.334274 (+ 2179us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":90,"threads_started":1}
W20260812 00:05:49.334415 30409 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:49.329594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:54505 (local address 127.19.59.126:44941)
0812 00:05:49.329647 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:49.329649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:49.329728 (+ 79us) server_negotiation.cc:407] Connection header received
0812 00:05:49.329783 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:49.329784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:49.329793 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:49.329866 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:49.330188 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:49.330640 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:49.331311 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:49.331499 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:49.331557 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:49.334365 (+ 2808us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:54505: BlockingRecv error: recv got EOF from 127.19.59.66:54505 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 12 00:05:49 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:49 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:49.457428 30411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:49.452668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:48851)
0812 00:05:49.452807 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:49.452823 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:49.452891 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:49.453032 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:49.453032 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:49.453199 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:49.453249 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:49.453250 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:49.453899 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:49.453900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:49.454403 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:49.454405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:49.454738 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:49.454739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:49.454784 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:49.455330 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:49.455342 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:49.457367 (+ 2025us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":59,"threads_started":1}
W20260812 00:05:49.457545 30409 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:49.452758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:48851 (local address 127.19.59.126:44941)
0812 00:05:49.452854 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:49.452855 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:49.452876 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:05:49.452968 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:49.452968 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:49.452980 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:49.453027 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:49.453305 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:49.453779 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:49.454487 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:49.454672 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:49.454723 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:49.457449 (+ 2726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:48851: BlockingRecv error: recv got EOF from 127.19.59.67:48851 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 00:05:50 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:50 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:50.222313 30412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:50.217141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:57789)
0812 00:05:50.217307 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:50.217324 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:50.217378 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:50.217537 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:50.217537 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:50.217715 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:50.217765 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:50.217766 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.218746 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.218747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:50.219285 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:50.219287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.219719 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.219720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:50.219764 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:50.220302 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:50.220307 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:50.222251 (+ 1944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":102,"threads_started":1}
W20260812 00:05:50.222507 30414 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:50.217230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:57789 (local address 127.19.59.126:44941)
0812 00:05:50.217396 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:50.217397 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:50.217407 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:50.217433 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:50.217433 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:50.217443 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:50.217516 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:50.217862 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.218677 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.219404 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.219628 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.219697 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:50.222402 (+ 2705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:57789: BlockingRecv error: recv got EOF from 127.19.59.65:57789 (error 108)
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":97,"threads_started":1}
Aug 12 00:05:50 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:50 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:50.345299 30415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:50.334946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:51275)
0812 00:05:50.335110 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:50.335121 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:50.335186 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:50.335330 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:50.335331 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:50.335494 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:50.335546 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:50.335547 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.336201 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.336201 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:50.337012 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:50.337014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.337384 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.337385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:50.337434 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:50.343393 (+ 5959us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:50.343398 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:50.345239 (+ 1841us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":112,"threads_started":1}
W20260812 00:05:50.345463 30414 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:50.335036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:51275 (local address 127.19.59.126:44941)
0812 00:05:50.335128 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:50.335130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:50.335175 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:05:50.335252 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:50.335253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:50.335266 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:50.335315 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:50.335615 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.336128 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.337099 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.337298 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.337354 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:50.345357 (+ 8003us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:51275: BlockingRecv error: recv got EOF from 127.19.59.66:51275 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 00:05:50 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:50 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:50.462764 30417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:50.457987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:45161)
0812 00:05:50.458149 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:50.458161 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:50.458231 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:50.458384 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:50.458385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:50.458580 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:50.458636 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:50.458638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.459373 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.459374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:50.459849 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:50.459850 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.460177 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.460178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:50.460221 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:50.460738 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:50.460743 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:50.462703 (+ 1960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":95,"threads_started":1}
W20260812 00:05:50.462954 30414 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:50.458047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:45161 (local address 127.19.59.126:44941)
0812 00:05:50.458144 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:50.458146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:50.458230 (+ 84us) server_negotiation.cc:407] Connection header received
0812 00:05:50.458278 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:50.458278 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:50.458291 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:50.458356 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:50.458710 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.459293 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.459926 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.460103 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.460152 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:50.462853 (+ 2701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:45161: BlockingRecv error: recv got EOF from 127.19.59.67:45161 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 12 00:05:51 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:51 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:51.227586 30418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:51.222878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:40435)
0812 00:05:51.223039 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:51.223050 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:51.223115 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:51.223308 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:51.223309 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:51.223492 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:51.223544 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:51.223546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.224173 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.224174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:51.224710 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:51.224712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.225035 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.225037 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:51.225085 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:51.225643 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:51.225656 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:51.227529 (+ 1873us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":106,"threads_started":1}
W20260812 00:05:51.227701 30419 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:51.223051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:40435 (local address 127.19.59.126:44941)
0812 00:05:51.223192 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:51.223194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:51.223201 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:51.223220 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:51.223221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:51.223230 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:51.223287 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:51.223627 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.224107 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.224780 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.224964 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.225013 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:51.227618 (+ 2605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:40435: BlockingRecv error: recv got EOF from 127.19.59.65:40435 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":89,"threads_started":1}
Aug 12 00:05:51 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:51 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:51.350366 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:51.345742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:33485)
0812 00:05:51.345969 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:51.345978 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:51.346031 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:51.346151 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:51.346152 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:51.346302 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:51.346348 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:51.346349 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.346908 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.346909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:51.347369 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:51.347370 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.347692 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.347693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:51.347746 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:51.348272 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:51.348276 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:51.350306 (+ 2030us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":138,"threads_started":1}
W20260812 00:05:51.350464 30419 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:51.345868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:33485 (local address 127.19.59.126:44941)
0812 00:05:51.345934 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:51.345936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:51.346036 (+ 100us) server_negotiation.cc:407] Connection header received
0812 00:05:51.346076 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:51.346076 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:51.346086 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:51.346134 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:51.346406 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.346849 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.347436 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.347599 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.347647 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:51.350379 (+ 2732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:33485: BlockingRecv error: recv got EOF from 127.19.59.66:33485 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 12 00:05:51 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:51 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:51.468215 30421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:51.463340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:57615)
0812 00:05:51.463496 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:51.463508 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:51.463568 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:51.463726 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:51.463727 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:51.463922 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:51.463969 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:51.463971 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.464643 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.464644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:51.465196 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:51.465198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.465561 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.465562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:51.465629 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:51.466117 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:51.466122 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:51.468124 (+ 2002us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":93,"threads_started":1}
W20260812 00:05:51.468264 30419 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:51.463463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:57615 (local address 127.19.59.126:44941)
0812 00:05:51.463545 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:51.463547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:51.463556 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:51.463631 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:51.463632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:51.463645 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:51.463707 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:51.464061 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.464557 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.465285 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.465484 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.465561 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:51.468201 (+ 2640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:57615: BlockingRecv error: recv got EOF from 127.19.59.67:57615 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 00:05:52 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:52 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:52.233078 30422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:52.228097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:55053)
0812 00:05:52.228275 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:52.228288 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:52.228346 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:52.228514 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:52.228515 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:52.228723 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:52.228772 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:52.228773 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:52.229409 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:52.229409 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:52.229978 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:52.229980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:52.230310 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:52.230310 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:52.230348 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:52.230819 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:52.230823 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:52.232977 (+ 2154us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":89,"threads_started":1}
W20260812 00:05:52.233132 30423 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:52.228210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:55053 (local address 127.19.59.126:44941)
0812 00:05:52.228346 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:52.228348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:52.228357 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:52.228395 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:52.228395 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:52.228405 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:52.228492 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:52.228843 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:52.229341 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:52.230049 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:52.230244 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:52.230300 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:52.233059 (+ 2759us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:55053: BlockingRecv error: recv got EOF from 127.19.59.65:55053 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":77,"threads_started":1}
Aug 12 00:05:52 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:52 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:52.355664 30424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:52.350875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:40209)
0812 00:05:52.351088 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:52.351102 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:52.351205 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:52.351360 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:52.351361 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:52.351577 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:52.351638 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:52.351640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:52.352346 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:52.352348 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:52.352916 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:52.352918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:52.353279 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:52.353280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:52.353337 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:52.353805 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:52.353824 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:52.355553 (+ 1729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":111,"threads_started":1}
W20260812 00:05:52.355706 30423 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:52.350997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:40209 (local address 127.19.59.126:44941)
0812 00:05:52.351092 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:52.351095 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:52.351185 (+ 90us) server_negotiation.cc:407] Connection header received
0812 00:05:52.351269 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:52.351270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:52.351288 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:52.351355 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:52.351744 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:52.352258 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:52.353006 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:52.353193 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:52.353279 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:52.355639 (+ 2360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:40209: BlockingRecv error: recv got EOF from 127.19.59.66:40209 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 00:05:52 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:52 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:52.473611 30425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:52.468809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:37349)
0812 00:05:52.468979 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:52.468992 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:52.469077 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:52.469222 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:52.469222 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:52.469428 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:52.469492 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:52.469494 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:52.470215 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:52.470216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:52.470746 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:52.470747 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:52.471116 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:52.471117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:52.471177 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:52.471631 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:52.471636 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:52.473545 (+ 1909us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":102,"threads_started":1}
W20260812 00:05:52.473727 30423 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:52.468867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:37349 (local address 127.19.59.126:44941)
0812 00:05:52.468911 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:52.468914 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:52.469061 (+ 147us) server_negotiation.cc:407] Connection header received
0812 00:05:52.469131 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:52.469132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:52.469147 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:52.469215 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:52.469576 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:52.470133 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:52.470834 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:52.471030 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:52.471114 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:52.473630 (+ 2516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:37349: BlockingRecv error: recv got EOF from 127.19.59.67:37349 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 12 00:05:53 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:53 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:53.238263 30426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:53.233624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:48573)
0812 00:05:53.233769 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:53.233779 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:53.233856 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:53.234019 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:53.234020 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:53.234204 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:53.234265 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:53.234267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:53.234993 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:53.234995 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:53.235559 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:53.235561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:53.235973 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:53.235974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:53.236056 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:53.236463 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:53.236471 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:53.238178 (+ 1707us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":79,"threads_started":1}
W20260812 00:05:53.238317 30427 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:53.233721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:48573 (local address 127.19.59.126:44941)
0812 00:05:53.233854 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:53.233856 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:53.233864 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:53.233941 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:53.233941 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:53.233951 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:53.234003 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:53.234340 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:53.234902 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:53.235649 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:53.235864 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:53.235969 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:53.238250 (+ 2281us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:48573: BlockingRecv error: recv got EOF from 127.19.59.65:48573 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
Aug 12 00:05:53 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:53 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:53.360728 30428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:53.356154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:51527)
0812 00:05:53.356295 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:53.356305 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:53.356360 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:53.356521 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:53.356522 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:53.356687 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:53.356748 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:53.356750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:53.357416 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:53.357417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:53.358093 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:53.358095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:53.358474 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:53.358475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:53.358541 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:53.358990 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:53.358994 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:53.360633 (+ 1639us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
W20260812 00:05:53.360793 30427 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:53.356199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:51527 (local address 127.19.59.126:44941)
0812 00:05:53.356258 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:53.356260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:53.356357 (+ 97us) server_negotiation.cc:407] Connection header received
0812 00:05:53.356433 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:53.356434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:53.356448 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:53.356499 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:53.356844 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:53.357332 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:53.358176 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:53.358380 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:53.358473 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:53.360730 (+ 2257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:51527: BlockingRecv error: recv got EOF from 127.19.59.66:51527 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 12 00:05:53 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:53 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:53.479149 30429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:53.474123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:47779)
0812 00:05:53.474254 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:53.474273 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:53.474363 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:53.474539 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:53.474540 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:53.474766 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:53.474866 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:53.474868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:53.475832 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:53.475834 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:53.476410 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:53.476412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:53.476778 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:53.476779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:53.476836 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:53.477266 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:53.477270 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:53.479057 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":73,"threads_started":1}
W20260812 00:05:53.479195 30427 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:53.474174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:47779 (local address 127.19.59.126:44941)
0812 00:05:53.474250 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:53.474252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:53.474360 (+ 108us) server_negotiation.cc:407] Connection header received
0812 00:05:53.474433 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:53.474434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:53.474448 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:53.474527 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:53.474956 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:53.475744 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:53.476496 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:53.476706 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:53.476779 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:53.479133 (+ 2354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:47779: BlockingRecv error: recv got EOF from 127.19.59.67:47779 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 12 00:05:54 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:54 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:54.243297 30430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:54.238744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:53265)
0812 00:05:54.238997 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:54.239012 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:54.239074 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:54.239230 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:54.239230 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:54.239397 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:54.239445 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:54.239446 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.240033 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.240034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:54.240486 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:54.240487 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.240775 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.240775 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:54.240810 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:54.241237 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:54.241241 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:54.243190 (+ 1949us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":76,"threads_started":1}
W20260812 00:05:54.243338 30432 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:54.238983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:53265 (local address 127.19.59.126:44941)
0812 00:05:54.239107 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:54.239108 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:54.239132 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:05:54.239152 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:54.239153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:54.239163 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:54.239212 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:54.239509 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.239963 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.240549 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.240717 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.240765 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:54.243270 (+ 2505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:53265: BlockingRecv error: recv got EOF from 127.19.59.65:53265 (error 108)
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":64,"threads_started":1}
Aug 12 00:05:54 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:54 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:54.365546 30433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:54.361284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:54265)
0812 00:05:54.361447 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:54.361456 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:54.361513 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:54.361631 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:54.361631 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:54.361782 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:54.361877 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:54.361878 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.362550 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.362550 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:54.362998 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:54.363000 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.363273 (+ 273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.363274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:54.363308 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:54.363715 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:54.363719 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:54.365448 (+ 1729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":105,"threads_started":1}
W20260812 00:05:54.365590 30432 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:54.361331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:54265 (local address 127.19.59.126:44941)
0812 00:05:54.361398 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:54.361400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:54.361514 (+ 114us) server_negotiation.cc:407] Connection header received
0812 00:05:54.361564 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:54.361564 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:54.361575 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:54.361611 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:54.361947 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.362485 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.363063 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.363220 (+ 157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.363263 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:54.365526 (+ 2263us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:54265: BlockingRecv error: recv got EOF from 127.19.59.66:54265 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 00:05:54 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:54 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:54.484699 30434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:54.479657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:47617)
0812 00:05:54.479840 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:54.479851 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:54.479934 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:54.480118 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:54.480119 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:54.480285 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:54.480348 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:54.480350 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.481156 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.481157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:54.481650 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:54.481652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.482001 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.482002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:54.482046 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:54.482583 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:54.482588 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:54.484640 (+ 2052us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":97,"threads_started":1}
W20260812 00:05:54.484848 30432 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:54.479730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:47617 (local address 127.19.59.126:44941)
0812 00:05:54.479778 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:54.479780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:54.479939 (+ 159us) server_negotiation.cc:407] Connection header received
0812 00:05:54.480028 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:54.480029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:54.480049 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:54.480092 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:54.480436 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.481052 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.481727 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.481937 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.481991 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:54.484761 (+ 2770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:47617: BlockingRecv error: recv got EOF from 127.19.59.67:47617 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 12 00:05:55 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:55 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:55.249177 30435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:55.243812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:53079)
0812 00:05:55.244017 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:55.244030 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:55.244094 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:55.244240 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:55.244240 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:55.244425 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:55.244478 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:55.244480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:55.245158 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:55.245159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:55.246082 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:55.246087 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:55.246476 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:55.246477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:55.246523 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:55.247063 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:55.247070 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:55.249078 (+ 2008us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":134,"threads_started":1}
W20260812 00:05:55.249277 30436 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:55.243938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:53079 (local address 127.19.59.126:44941)
0812 00:05:55.244046 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:55.244048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:55.244076 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:05:55.244150 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:55.244151 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:55.244161 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:55.244218 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:55.244546 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:55.245087 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:55.246190 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:55.246396 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:55.246464 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:55.249182 (+ 2718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:53079: BlockingRecv error: recv got EOF from 127.19.59.65:53079 (error 108)
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":54,"threads_started":1}
Aug 12 00:05:55 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:55 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:55.375612 30438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:55.366049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:40707)
0812 00:05:55.366263 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:55.366272 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:55.366347 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:55.366484 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:55.366484 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:55.366661 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:55.366708 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:55.366710 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:55.367339 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:55.367340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:55.367794 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:55.367795 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:55.368122 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:55.368123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:55.368172 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:55.373503 (+ 5331us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:55.373508 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:55.375501 (+ 1993us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":123,"threads_started":1}
W20260812 00:05:55.375650 30436 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:55.366141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:40707 (local address 127.19.59.126:44941)
0812 00:05:55.366242 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:55.366243 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:55.366332 (+ 89us) server_negotiation.cc:407] Connection header received
0812 00:05:55.366395 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:55.366396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:55.366408 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:55.366473 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:55.366788 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:55.367266 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:55.367874 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:55.368058 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:55.368125 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:55.375583 (+ 7458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:40707: BlockingRecv error: recv got EOF from 127.19.59.66:40707 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 12 00:05:55 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:55 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:55.490370 30441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:55.485175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:37619)
0812 00:05:55.485326 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:55.485337 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:55.485401 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:55.485529 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:55.485529 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:55.485700 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:55.485751 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:55.485752 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:55.486462 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:55.486463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:55.487005 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:55.487007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:55.487405 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:55.487405 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:55.487449 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:55.488062 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:55.488069 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:55.490300 (+ 2231us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":91,"threads_started":1}
W20260812 00:05:55.490478 30436 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:55.485256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:37619 (local address 127.19.59.126:44941)
0812 00:05:55.485330 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:55.485331 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:55.485402 (+ 71us) server_negotiation.cc:407] Connection header received
0812 00:05:55.485447 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:55.485447 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:55.485459 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:55.485511 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:55.485852 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:55.486358 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:55.487125 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:55.487310 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:55.487392 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:55.490406 (+ 3014us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:37619: BlockingRecv error: recv got EOF from 127.19.59.67:37619 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 12 00:05:56 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:56 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:56.254318 30442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:56.249743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:60211)
0812 00:05:56.249898 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:56.249911 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:56.249985 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:56.250100 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:56.250101 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:56.250278 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:56.250326 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:56.250327 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.250979 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.250979 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:56.251441 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:56.251442 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.251814 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.251814 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:56.251852 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:56.252292 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:56.252297 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:56.254220 (+ 1923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
W20260812 00:05:56.254351 30443 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:56.249807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:60211 (local address 127.19.59.126:44941)
0812 00:05:56.249944 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:56.249946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:56.249970 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:05:56.250033 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:56.250034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:56.250043 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:56.250085 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:56.250432 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.250916 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.251523 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.251747 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.251802 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:56.254285 (+ 2483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:60211: BlockingRecv error: recv got EOF from 127.19.59.65:60211 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":94,"threads_started":1}
Aug 12 00:05:56 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:56 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:56.380862 30444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:56.376096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:55519)
0812 00:05:56.376280 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:56.376290 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:56.376355 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:56.376491 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:56.376492 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:56.376648 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:56.376696 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:56.376698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.377351 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.377353 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:56.377954 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:56.377956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.378374 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.378375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:56.378431 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:56.378951 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:56.378956 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:56.380772 (+ 1816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":88,"threads_started":1}
W20260812 00:05:56.380906 30443 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:56.376173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:55519 (local address 127.19.59.126:44941)
0812 00:05:56.376246 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:56.376248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:56.376357 (+ 109us) server_negotiation.cc:407] Connection header received
0812 00:05:56.376413 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:56.376413 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:56.376425 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:56.376471 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:56.376757 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.377256 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.378043 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.378284 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.378370 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:56.380850 (+ 2480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:55519: BlockingRecv error: recv got EOF from 127.19.59.66:55519 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 12 00:05:56 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:56 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:56.496042 30446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:56.490919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:32851)
0812 00:05:56.491081 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:56.491100 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:56.491159 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:56.491331 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:56.491332 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:56.491508 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:56.491557 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:56.491558 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.492240 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.492242 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:56.492830 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:56.492832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.493243 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.493244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:56.493293 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:56.493783 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:56.493788 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:56.495978 (+ 2190us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":76,"threads_started":1}
W20260812 00:05:56.496178 30443 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:56.491070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:32851 (local address 127.19.59.126:44941)
0812 00:05:56.491145 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:56.491146 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:56.491155 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:56.491238 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:56.491239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:56.491249 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:56.491298 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:56.491635 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.492142 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.492926 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.493139 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.493195 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:56.496071 (+ 2876us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:32851: BlockingRecv error: recv got EOF from 127.19.59.67:32851 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 00:05:57 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:57 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:57.260031 30447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:57.254900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:54005)
0812 00:05:57.255061 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:57.255072 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:57.255135 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:57.255310 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:57.255311 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:57.255510 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:57.255563 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:57.255564 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:57.256289 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:57.256291 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:57.256903 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:57.256906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:57.257258 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:57.257259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:57.257306 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:57.257786 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:57.257791 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:57.259920 (+ 2129us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":97,"threads_started":1}
W20260812 00:05:57.260074 30448 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:57.254933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:54005 (local address 127.19.59.126:44941)
0812 00:05:57.255088 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:57.255090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:57.255124 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:05:57.255210 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:57.255211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:57.255221 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:57.255288 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:57.255629 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:57.256195 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:57.256994 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:57.257189 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:57.257246 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:57.260002 (+ 2756us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:54005: BlockingRecv error: recv got EOF from 127.19.59.65:54005 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":100,"threads_started":1}
Aug 12 00:05:57 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:57 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:57.385528 30449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:57.381364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:56581)
0812 00:05:57.381482 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:57.381492 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:57.381553 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:57.381655 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:57.381656 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:57.381844 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:57.381905 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:57.381906 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:57.382478 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:57.382479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:57.382964 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:57.382965 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:57.383270 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:57.383271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:57.383307 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:57.383744 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:57.383748 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:57.385457 (+ 1709us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":66,"threads_started":1}
W20260812 00:05:57.385592 30448 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:57.381394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:56581 (local address 127.19.59.126:44941)
0812 00:05:57.381455 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:57.381457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:57.381556 (+ 99us) server_negotiation.cc:407] Connection header received
0812 00:05:57.381595 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:57.381595 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:57.381605 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:57.381653 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:57.381972 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:57.382415 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:57.383029 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:57.383196 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:57.383257 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:57.385545 (+ 2288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:56581: BlockingRecv error: recv got EOF from 127.19.59.66:56581 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 12 00:05:57 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:57 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:57.501349 30450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:57.496593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:34095)
0812 00:05:57.496750 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:57.496760 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:57.496828 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:57.496978 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:57.496978 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:57.497150 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:57.497197 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:57.497198 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:57.498024 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:57.498025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:57.498514 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:57.498515 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:57.498833 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:57.498834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:57.498890 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:57.499374 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:57.499383 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:57.501235 (+ 1852us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":109,"threads_started":1}
W20260812 00:05:57.501384 30448 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:57.496654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:34095 (local address 127.19.59.126:44941)
0812 00:05:57.496731 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:57.496733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:57.496823 (+ 90us) server_negotiation.cc:407] Connection header received
0812 00:05:57.496896 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:57.496896 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:57.496912 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:57.496965 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:57.497269 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:57.497953 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:57.498585 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:57.498761 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:57.498819 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:57.501317 (+ 2498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:34095: BlockingRecv error: recv got EOF from 127.19.59.67:34095 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 12 00:05:58 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:58 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:58.264848 30451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:58.260457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:50485)
0812 00:05:58.260572 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:58.260585 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:58.260642 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:58.260789 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:58.260789 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:58.260975 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:58.261023 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:58.261024 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:58.261634 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:58.261635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:58.262210 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:58.262212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:58.262539 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:58.262540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:58.262577 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:58.263060 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:58.263065 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:58.264746 (+ 1681us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":56,"threads_started":1}
W20260812 00:05:58.264890 30454 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:58.260526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:50485 (local address 127.19.59.126:44941)
0812 00:05:58.260676 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:58.260677 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:58.260685 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:58.260704 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:58.260704 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:58.260714 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:58.260771 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:58.261090 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:58.261571 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:58.262282 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:58.262482 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:58.262529 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:58.264821 (+ 2292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:50485: BlockingRecv error: recv got EOF from 127.19.59.65:50485 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
Aug 12 00:05:58 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:58 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:58.390602 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:58.386065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:43737)
0812 00:05:58.386250 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:58.386263 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:58.386355 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:58.386527 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:58.386528 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:58.386701 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:58.386745 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:58.386746 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:58.387375 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:58.387376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:58.387929 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:58.387931 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:58.388244 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:58.388245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:58.388294 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:58.388763 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:58.388767 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:58.390510 (+ 1743us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":94,"threads_started":1}
W20260812 00:05:58.390654 30454 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:58.386182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:43737 (local address 127.19.59.126:44941)
0812 00:05:58.386259 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:58.386262 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:58.386335 (+ 73us) server_negotiation.cc:407] Connection header received
0812 00:05:58.386433 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:58.386434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:58.386447 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:58.386511 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:58.386816 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:58.387299 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:58.388003 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:58.388181 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:58.388246 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:58.390592 (+ 2346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:43737: BlockingRecv error: recv got EOF from 127.19.59.66:43737 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 00:05:58 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:58 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:58.506774 30456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:58.501848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:35127)
0812 00:05:58.502034 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:58.502053 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:58.502141 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:58.502306 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:58.502308 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:58.502506 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:58.502553 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:58.502555 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:58.503279 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:58.503281 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:58.503762 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:58.503764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:58.504139 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:58.504140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:58.504203 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:58.504685 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:58.504689 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:58.506716 (+ 2027us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":69,"threads_started":1}
W20260812 00:05:58.506917 30454 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:58.501911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:35127 (local address 127.19.59.126:44941)
0812 00:05:58.502015 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:58.502018 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:58.502120 (+ 102us) server_negotiation.cc:407] Connection header received
0812 00:05:58.502213 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:58.502214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:58.502228 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:58.502299 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:58.502640 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:58.503199 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:58.503845 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:58.504062 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:58.504137 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:58.506825 (+ 2688us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:35127: BlockingRecv error: recv got EOF from 127.19.59.67:35127 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 00:05:59 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:59 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:59.269791 30457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:59.265317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:60401)
0812 00:05:59.265482 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:59.265498 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:59.265548 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:59.265728 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:59.265729 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:59.265921 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:59.265969 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:59.265970 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.266625 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.266626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:59.267118 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:59.267119 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.267423 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.267424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:59.267460 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:59.267870 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:59.267874 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:59.269736 (+ 1862us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":103,"threads_started":1}
W20260812 00:05:59.269968 30458 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:59.265464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:60401 (local address 127.19.59.126:44941)
0812 00:05:59.265603 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:59.265605 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:59.265613 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:59.265634 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:59.265635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:59.265645 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:59.265710 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:59.266039 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.266536 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.267187 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.267360 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.267409 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:59.269851 (+ 2442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:60401: BlockingRecv error: recv got EOF from 127.19.59.65:60401 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":84,"threads_started":1}
Aug 12 00:05:59 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:59 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:59.395860 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:59.391079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:35507)
0812 00:05:59.391220 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:59.391231 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:59.391297 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:59.391448 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:59.391449 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:59.391653 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:59.391715 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:59.391717 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.392423 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.392424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:59.392997 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:59.392998 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.393371 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.393372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:59.393427 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:59.393934 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:59.393939 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:59.395746 (+ 1807us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
W20260812 00:05:59.395898 30458 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:59.391218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:35507 (local address 127.19.59.126:44941)
0812 00:05:59.391280 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:59.391282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:59.391291 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:59.391351 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:59.391352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:59.391363 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:59.391426 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:59.391803 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.392314 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.393078 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.393295 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.393373 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:59.395833 (+ 2460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:35507: BlockingRecv error: recv got EOF from 127.19.59.66:35507 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 00:05:59 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:05:59 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:05:59.511966 30462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:59.507269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:38983)
0812 00:05:59.507433 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:59.507444 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:59.507530 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:59.507681 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:59.507682 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:59.507875 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:59.507924 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:59.507926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.508598 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.508599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:59.509195 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:59.509197 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.509595 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.509596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:59.509660 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:59.510101 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:59.510106 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:59.511851 (+ 1745us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":75,"threads_started":1}
W20260812 00:05:59.512005 30458 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:59.507334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:38983 (local address 127.19.59.126:44941)
0812 00:05:59.507378 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:59.507381 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:59.507515 (+ 134us) server_negotiation.cc:407] Connection header received
0812 00:05:59.507587 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:59.507588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:59.507601 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:59.507674 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:59.508013 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.508515 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.509288 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.509500 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.509592 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:59.511935 (+ 2343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:38983: BlockingRecv error: recv got EOF from 127.19.59.67:38983 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 12 00:06:00 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:06:00 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:06:00.275655 30463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:00.270315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:51701)
0812 00:06:00.270515 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:00.270529 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:00.270607 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:00.270761 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:00.270762 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:00.270963 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:00.271018 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:00.271019 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.271673 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.271673 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:00.272265 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:00.272267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.272626 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.272626 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:00.272673 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:00.273298 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:00.273304 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:00.275584 (+ 2280us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":132,"threads_started":1}
W20260812 00:06:00.275804 30464 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:00.270420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:51701 (local address 127.19.59.126:44941)
0812 00:06:00.270559 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:00.270561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:00.270588 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:06:00.270672 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:00.270673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:00.270683 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:00.270734 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:00.271089 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.271578 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.272346 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.272550 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.272604 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:00.275698 (+ 3094us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:51701: BlockingRecv error: recv got EOF from 127.19.59.65:51701 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
Aug 12 00:06:00 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:06:00 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:06:00.406527 30465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:00.396453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:50631)
0812 00:06:00.396656 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:00.396667 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:00.396725 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:00.396888 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:00.396889 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:00.397090 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:00.397142 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:00.397143 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.397949 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.397950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:00.398465 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:00.398466 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.398866 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.398868 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:00.398918 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:00.404639 (+ 5721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:00.404643 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:00.406469 (+ 1826us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":128,"threads_started":1}
W20260812 00:06:00.406714 30464 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:00.396547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:50631 (local address 127.19.59.126:44941)
0812 00:06:00.396622 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:00.396624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:00.396722 (+ 98us) server_negotiation.cc:407] Connection header received
0812 00:06:00.396796 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:00.396797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:00.396807 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:00.396859 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:00.397216 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.397837 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.398582 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.398784 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.398846 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:00.406603 (+ 7757us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:50631: BlockingRecv error: recv got EOF from 127.19.59.66:50631 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 12 00:06:00 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:06:00 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.67@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:06:00.517055 30466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:00.512485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.67:47857)
0812 00:06:00.512632 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:00.512645 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:00.512723 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:00.512879 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:00.512880 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:00.513064 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:00.513116 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:00.513117 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.513733 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.513734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:00.514281 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:00.514284 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.514641 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.514642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:00.514683 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:00.515142 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:00.515146 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:00.516999 (+ 1853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":58,"threads_started":1}
W20260812 00:06:00.517200 30464 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:00.512586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:47857 (local address 127.19.59.126:44941)
0812 00:06:00.512668 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:00.512670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:00.512705 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:06:00.512779 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:00.512780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:00.512792 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:00.512853 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:00.513185 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.513662 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.514361 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.514569 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.514625 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:00.517093 (+ 2468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.67:47857: BlockingRecv error: recv got EOF from 127.19.59.67:47857 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 00:06:01 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:06:01 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.65@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:06:01.281010 30467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:01.276223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.65:41277)
0812 00:06:01.276364 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:01.276376 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:01.276434 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:01.276559 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:01.276560 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:01.276746 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:01.276811 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:01.276813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.277605 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.277606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:01.278226 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:01.278229 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.278535 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.278536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:01.278575 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:01.278988 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:01.278992 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:01.280904 (+ 1912us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":88,"threads_started":1}
W20260812 00:06:01.281040 30468 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:01.276307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:41277 (local address 127.19.59.126:44941)
0812 00:06:01.276416 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:01.276418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:01.276427 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:06:01.276483 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:01.276484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:01.276494 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:01.276545 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:01.276871 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.277496 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.278292 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.278471 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.278520 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:01.280979 (+ 2459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.65:41277: BlockingRecv error: recv got EOF from 127.19.59.65:41277 (error 108)
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":51,"threads_started":1}
Aug 12 00:06:01 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:06:01 dist-test-slave-6nmv krb5kdc[29216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.59.66@KRBTEST.COM for oryx/127.19.59.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:06:01.411183 30469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:01.407024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:44941 (local address 127.19.59.66:48179)
0812 00:06:01.407158 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:01.407173 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:01.407224 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:01.407356 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:01.407356 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:01.407516 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:01.407565 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:01.407566 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.408193 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.408193 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:01.408711 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:01.408712 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.409006 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.409007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:01.409044 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:01.409441 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:01.409444 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:01.411109 (+ 1665us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.59.126:44941: Server oryx/127.19.59.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
W20260812 00:06:01.411296 30468 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:01.407074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:48179 (local address 127.19.59.126:44941)
0812 00:06:01.407159 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:01.407161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:01.407228 (+ 67us) server_negotiation.cc:407] Connection header received
0812 00:06:01.407282 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:01.407283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:01.407293 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:01.407336 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:01.407623 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.408119 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.408775 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.408948 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.408993 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:01.411202 (+ 2209us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.59.66:48179: BlockingRecv error: recv got EOF from 127.19.59.66:48179 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 00:06:01.437011 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 29898
I20260812 00:06:01.443662 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 30079
I20260812 00:06:01.451227 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 30238
I20260812 00:06:01.457659 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 29819
2026-08-12T00:06:01Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17479 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T00:06:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:01Z Disabled control of system clock
I20260812 00:06:01.486647 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:41385
--webserver_interface=127.19.59.126
--webserver_port=0
--builtin_ntp_servers=127.19.59.84:43935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:41385
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 00:06:01.566038 30474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:01.566236 30474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:01.566258 30474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:01.567322 30474 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:01.567358 30474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:01.567373 30474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:01.567385 30474 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:01.567399 30474 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:01.568699 30474 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:43935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:41385
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:41385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:01.568907 30474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:01.569125 30474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:06:01.574232 30474 server_base.cc:1034] running on GCE node
W20260812 00:06:01.574277 30481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:01.574239 30483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:01.574210 30480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:01.574676 30474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:01.574954 30474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:01.576123 30474 hybrid_clock.cc:648] HybridClock initialized: now 1786493161576110 us; error 49 us; skew 500 ppm
I20260812 00:06:01.577320 30474 webserver.cc:460] Webserver started at http://127.19.59.126:38487/ using document root <none> and password file <none>
I20260812 00:06:01.577572 30474 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:01.577643 30474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:01.577849 30474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:01.578905 30474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "3a3eaaaebf474c59b6b00cbbd1c19f78"
format_stamp: "Formatted at 2026-08-12 00:06:01 on dist-test-slave-6nmv"
server_key: "28adf091bc2c42ecaced324975ad3023"
server_key_iv: "cfcbf4c53e4d8fa8c126fd341d65e9a4"
server_key_version: "encryptionkey@0"
I20260812 00:06:01.579267 30474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "3a3eaaaebf474c59b6b00cbbd1c19f78"
format_stamp: "Formatted at 2026-08-12 00:06:01 on dist-test-slave-6nmv"
server_key: "28adf091bc2c42ecaced324975ad3023"
server_key_iv: "cfcbf4c53e4d8fa8c126fd341d65e9a4"
server_key_version: "encryptionkey@0"
I20260812 00:06:01.580580 30474 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:06:01.581328 30489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:01.581499 30474 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:06:01.581593 30474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "3a3eaaaebf474c59b6b00cbbd1c19f78"
format_stamp: "Formatted at 2026-08-12 00:06:01 on dist-test-slave-6nmv"
server_key: "28adf091bc2c42ecaced324975ad3023"
server_key_iv: "cfcbf4c53e4d8fa8c126fd341d65e9a4"
server_key_version: "encryptionkey@0"
I20260812 00:06:01.581676 30474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:01.594247 30474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:01.594544 30474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:01.594693 30474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:01.598681 30474 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:41385
I20260812 00:06:01.598711 30551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:41385 every 8 connection(s)
I20260812 00:06:01.599045 30474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:01.599629 30552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:01.600495 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 30474
I20260812 00:06:01.600587 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:06:01.600759 19693 external_mini_cluster.cc:1428] Setting key 0287dabb960668c686c718635f871a09
I20260812 00:06:01.602829 30552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78: Bootstrap starting.
I20260812 00:06:01.603456 30552 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:01.603739 30552 log.cc:824] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:01.604471 30552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78: No bootstrap required, opened a new log
I20260812 00:06:01.606469 30556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:01.601242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39598 (local address 127.19.59.126:41385)
0812 00:06:01.601454 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:01.601462 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:01.601492 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:06:01.602055 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:01.602062 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:01.602136 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:01.602270 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:01.602427 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.603621 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.604351 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.604880 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.604998 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:01.605587 (+ 589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:01.605592 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:01.605592 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:01.605822 (+ 230us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:01.605887 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:01.605902 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:01.605964 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:01.606035 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:06:01.606108 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":85,"threads_started":1}
I20260812 00:06:01.606424 30552 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3eaaaebf474c59b6b00cbbd1c19f78" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 41385 } }
I20260812 00:06:01.606582 30552 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:01.606612 30552 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a3eaaaebf474c59b6b00cbbd1c19f78, State: Initialized, Role: FOLLOWER
I20260812 00:06:01.606771 30552 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3eaaaebf474c59b6b00cbbd1c19f78" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 41385 } }
I20260812 00:06:01.606861 30552 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:06:01.606889 30552 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:06:01.606932 30552 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:01.607455 30552 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3eaaaebf474c59b6b00cbbd1c19f78" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 41385 } }
I20260812 00:06:01.607537 30552 leader_election.cc:302] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a3eaaaebf474c59b6b00cbbd1c19f78; no voters:
I20260812 00:06:01.607656 30552 leader_election.cc:288] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:06:01.607728 30559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:01.607877 30552 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:01.607892 30559 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [term 1 LEADER]: Becoming Leader. State: Replica: 3a3eaaaebf474c59b6b00cbbd1c19f78, State: Running, Role: LEADER
I20260812 00:06:01.608002 30559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3eaaaebf474c59b6b00cbbd1c19f78" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 41385 } }
I20260812 00:06:01.608311 30560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a3eaaaebf474c59b6b00cbbd1c19f78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3eaaaebf474c59b6b00cbbd1c19f78" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 41385 } } }
I20260812 00:06:01.608320 30561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a3eaaaebf474c59b6b00cbbd1c19f78. Latest consensus state: current_term: 1 leader_uuid: "3a3eaaaebf474c59b6b00cbbd1c19f78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3eaaaebf474c59b6b00cbbd1c19f78" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 41385 } } }
I20260812 00:06:01.608433 30560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:01.608438 30561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:01.608892 30571 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:01.609337 30571 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:01.610751 30571 catalog_manager.cc:1347] Generated new cluster ID: ec1c987e1b894b6ba18ef8419b482b75
I20260812 00:06:01.610809 30571 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:06:01.621773 30571 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:01.622247 30571 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:01.628026 30571 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a3eaaaebf474c59b6b00cbbd1c19f78: Generated new TSK 0
I20260812 00:06:01.628167 30571 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:06:01.635520 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:41385
--builtin_ntp_servers=127.19.59.84:43935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 00:06:01.736470 30583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:01.736672 30583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:01.736697 30583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:01.737771 30583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:01.737859 30583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:01.737901 30583 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:06:01.739173 30583 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:43935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:41385
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:01.739418 30583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:01.739729 30583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:06:01.744740 30583 server_base.cc:1034] running on GCE node
W20260812 00:06:01.744686 30590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:01.744696 30589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:01.744735 30592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:01.745172 30583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:01.745411 30583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:01.746567 30583 hybrid_clock.cc:648] HybridClock initialized: now 1786493161746554 us; error 30 us; skew 500 ppm
I20260812 00:06:01.747891 30583 webserver.cc:460] Webserver started at http://127.19.59.65:40835/ using document root <none> and password file <none>
I20260812 00:06:01.748116 30583 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:01.748186 30583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:01.748313 30583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:01.749660 30583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "a05ec215b6c3454da0361b1078029cc3"
format_stamp: "Formatted at 2026-08-12 00:06:01 on dist-test-slave-6nmv"
server_key: "5535d0bddfa58c2a180b45b9ded60562"
server_key_iv: "0170aeeccb0496b83e7f9a022cd36f29"
server_key_version: "encryptionkey@0"
I20260812 00:06:01.750090 30583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "a05ec215b6c3454da0361b1078029cc3"
format_stamp: "Formatted at 2026-08-12 00:06:01 on dist-test-slave-6nmv"
server_key: "5535d0bddfa58c2a180b45b9ded60562"
server_key_iv: "0170aeeccb0496b83e7f9a022cd36f29"
server_key_version: "encryptionkey@0"
I20260812 00:06:01.751722 30583 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:06:01.752583 30598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:01.752846 30583 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:06:01.752962 30583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "a05ec215b6c3454da0361b1078029cc3"
format_stamp: "Formatted at 2026-08-12 00:06:01 on dist-test-slave-6nmv"
server_key: "5535d0bddfa58c2a180b45b9ded60562"
server_key_iv: "0170aeeccb0496b83e7f9a022cd36f29"
server_key_version: "encryptionkey@0"
I20260812 00:06:01.753043 30583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:01.770879 30583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:01.771147 30583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:01.771302 30583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:01.771533 30583 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:06:01.771873 30583 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:06:01.771938 30583 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:01.771974 30583 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:06:01.772001 30583 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:01.778044 30583 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:41479
I20260812 00:06:01.778100 30729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:41479 every 8 connection(s)
I20260812 00:06:01.778405 30583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:06:01.781599 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 30583
I20260812 00:06:01.781723 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:06:01.782073 19693 external_mini_cluster.cc:1428] Setting key 7f1ffa97f58fa60032216f93f4fc2f48
I20260812 00:06:01.783089 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:41385
--builtin_ntp_servers=127.19.59.84:43935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 00:06:01.783921 30556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:01.779121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:47099 (local address 127.19.59.126:41385)
0812 00:06:01.779186 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:01.779188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:01.779418 (+ 230us) server_negotiation.cc:407] Connection header received
0812 00:06:01.779873 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:01.779874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:01.779884 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:01.779936 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:01.780528 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.780996 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.782334 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.782589 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.782667 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:01.783589 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:01.783591 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:01.783591 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:01.783596 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:01.783613 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:01.783618 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:01.783677 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:01.783748 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:06:01.783780 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 00:06:01.784067 30732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:01.779103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:41385 (local address 127.19.59.65:47099)
0812 00:06:01.779288 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:01.779319 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:01.779791 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:01.779989 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:01.779992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:01.779999 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:01.780453 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:01.780457 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.781077 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.781078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:01.782234 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:01.782238 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.782686 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.782687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:01.782846 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:01.783453 (+ 607us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:06:01.783454 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:01.783481 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:06:01.783504 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:01.783687 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:01.783691 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:01.783693 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:06:01.783749 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 00:06:01.783847 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260812 00:06:01.784541 30730 heartbeater.cc:347] Connected to a master server at 127.19.59.126:41385
I20260812 00:06:01.784658 30730 heartbeater.cc:464] Registering TS with master...
I20260812 00:06:01.784864 30730 heartbeater.cc:511] Master 127.19.59.126:41385 requested a full tablet report, sending...
I20260812 00:06:01.785415 30507 ts_manager.cc:194] Registered new tserver with Master: a05ec215b6c3454da0361b1078029cc3 (127.19.59.65:41479)
I20260812 00:06:01.786113 30507 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.59.65:47099
W20260812 00:06:01.864085 30734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:01.864321 30734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:01.864369 30734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:01.865502 30734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:01.865569 30734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:01.865614 30734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:06:01.866993 30734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:43935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:41385
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:01.867264 30734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:01.867573 30734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:01.872668 30744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:01.872622 30740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:01.872622 30741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:01.872638 30734 server_base.cc:1034] running on GCE node
I20260812 00:06:01.873142 30734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:01.873356 30734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:01.874517 30734 hybrid_clock.cc:648] HybridClock initialized: now 1786493161874499 us; error 40 us; skew 500 ppm
I20260812 00:06:01.875826 30734 webserver.cc:460] Webserver started at http://127.19.59.66:38095/ using document root <none> and password file <none>
I20260812 00:06:01.876080 30734 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:01.876129 30734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:01.876273 30734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:01.877326 30734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "8ddfdfd920ac4ccfb997be5582758cbc"
format_stamp: "Formatted at 2026-08-12 00:06:01 on dist-test-slave-6nmv"
server_key: "e15566173acdd514626298c2ff0d2bc6"
server_key_iv: "a0baecb217f75a8cf45475ff00f739c9"
server_key_version: "encryptionkey@0"
I20260812 00:06:01.877688 30734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "8ddfdfd920ac4ccfb997be5582758cbc"
format_stamp: "Formatted at 2026-08-12 00:06:01 on dist-test-slave-6nmv"
server_key: "e15566173acdd514626298c2ff0d2bc6"
server_key_iv: "a0baecb217f75a8cf45475ff00f739c9"
server_key_version: "encryptionkey@0"
I20260812 00:06:01.879137 30734 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:06:01.879868 30750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:01.880055 30734 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:06:01.880143 30734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "8ddfdfd920ac4ccfb997be5582758cbc"
format_stamp: "Formatted at 2026-08-12 00:06:01 on dist-test-slave-6nmv"
server_key: "e15566173acdd514626298c2ff0d2bc6"
server_key_iv: "a0baecb217f75a8cf45475ff00f739c9"
server_key_version: "encryptionkey@0"
I20260812 00:06:01.880214 30734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:01.899878 30734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:01.900209 30734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:01.900342 30734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:01.900576 30734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:06:01.900887 30734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:06:01.900941 30734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:01.900979 30734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:06:01.901005 30734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:01.906852 30734 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:39591
I20260812 00:06:01.906898 30881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:39591 every 8 connection(s)
I20260812 00:06:01.907280 30734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:06:01.909083 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 30734
I20260812 00:06:01.909206 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:06:01.909401 19693 external_mini_cluster.cc:1428] Setting key cb7f4c3d10e7ff3e4848b2e8d52701ec
I20260812 00:06:01.910465 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:41385
--builtin_ntp_servers=127.19.59.84:43935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 00:06:01.913050 30556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:01.908037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:52639 (local address 127.19.59.126:41385)
0812 00:06:01.908084 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:01.908087 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:01.908277 (+ 190us) server_negotiation.cc:407] Connection header received
0812 00:06:01.908886 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:01.908887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:01.908899 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:01.909025 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:01.909950 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.910523 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.911596 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.911797 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.911873 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:01.912751 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:01.912752 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:01.912753 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:01.912758 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:01.912773 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:01.912778 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:01.912866 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:01.912941 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 00:06:01.912973 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:06:01.913267 30885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:01.907985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:41385 (local address 127.19.59.66:52639)
0812 00:06:01.908166 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:01.908205 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:01.908788 (+ 583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:01.909103 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:01.909108 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:01.909118 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:01.909815 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:01.909851 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.910701 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.910702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:01.911499 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:01.911501 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:01.911895 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:01.911896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:01.912039 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:01.912608 (+ 569us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:06:01.912609 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:01.912636 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:06:01.912658 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:01.912867 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:01.912873 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:01.912876 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:06:01.912942 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 00:06:01.913040 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260812 00:06:01.913762 30883 heartbeater.cc:347] Connected to a master server at 127.19.59.126:41385
I20260812 00:06:01.913895 30883 heartbeater.cc:464] Registering TS with master...
I20260812 00:06:01.914081 30883 heartbeater.cc:511] Master 127.19.59.126:41385 requested a full tablet report, sending...
I20260812 00:06:01.914438 30507 ts_manager.cc:194] Registered new tserver with Master: 8ddfdfd920ac4ccfb997be5582758cbc (127.19.59.66:39591)
I20260812 00:06:01.914921 30507 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.59.66:52639
W20260812 00:06:01.993275 30887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:01.993530 30887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:01.993569 30887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:01.994791 30887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:01.994860 30887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:01.994904 30887 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:06:01.996246 30887 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:43935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:41385
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:01.996513 30887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:01.996829 30887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:02.001914 30894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:02.001936 30893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:02.001919 30897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:02.002220 30887 server_base.cc:1034] running on GCE node
I20260812 00:06:02.002413 30887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:02.002662 30887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:02.003854 30887 hybrid_clock.cc:648] HybridClock initialized: now 1786493162003842 us; error 39 us; skew 500 ppm
I20260812 00:06:02.005237 30887 webserver.cc:460] Webserver started at http://127.19.59.67:33327/ using document root <none> and password file <none>
I20260812 00:06:02.005496 30887 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:02.005568 30887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:02.005721 30887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:02.006847 30887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "5f9f6467ba5b492697587b5ea41ab451"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-6nmv"
server_key: "7d9304c3db07da1bde65f0161456d3c7"
server_key_iv: "4c6c3bcb9c87b409524e6e03950699d5"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.007222 30887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "5f9f6467ba5b492697587b5ea41ab451"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-6nmv"
server_key: "7d9304c3db07da1bde65f0161456d3c7"
server_key_iv: "4c6c3bcb9c87b409524e6e03950699d5"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.008749 30887 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:06:02.009454 30904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.009621 30887 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:06:02.009718 30887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "5f9f6467ba5b492697587b5ea41ab451"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-6nmv"
server_key: "7d9304c3db07da1bde65f0161456d3c7"
server_key_iv: "4c6c3bcb9c87b409524e6e03950699d5"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.009795 30887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:02.023591 30887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:02.023888 30887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:02.024034 30887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:02.024257 30887 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:06:02.024583 30887 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:06:02.024636 30887 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.024678 30887 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:06:02.024704 30887 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.030489 30887 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:39509
I20260812 00:06:02.030541 31036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:39509 every 8 connection(s)
I20260812 00:06:02.030848 30887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:06:02.035938 30556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:02.031540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:43223 (local address 127.19.59.126:41385)
0812 00:06:02.031627 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:02.031630 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:02.031882 (+ 252us) server_negotiation.cc:407] Connection header received
0812 00:06:02.032374 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:02.032375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:02.032385 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:02.032437 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:02.033083 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:02.033577 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:02.034559 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:02.034731 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:02.034781 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:02.035670 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:02.035672 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:02.035672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:02.035676 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:02.035690 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:02.035694 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:02.035748 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:02.035831 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 00:06:02.035854 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 00:06:02.036101 31040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:02.031533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:41385 (local address 127.19.59.67:43223)
0812 00:06:02.031775 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:02.031808 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:02.032288 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:02.032487 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:02.032490 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:02.032498 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:02.033012 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:02.033016 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:02.033655 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:02.033656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:02.034484 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:02.034487 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:02.034804 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:02.034805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:02.034940 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:02.035529 (+ 589us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:06:02.035529 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:02.035557 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:06:02.035579 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:02.035756 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:02.035760 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:02.035762 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:06:02.035813 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:06:02.035889 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":139,"threads_started":1}
I20260812 00:06:02.036617 31038 heartbeater.cc:347] Connected to a master server at 127.19.59.126:41385
I20260812 00:06:02.036707 31038 heartbeater.cc:464] Registering TS with master...
I20260812 00:06:02.036741 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 30887
I20260812 00:06:02.036868 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:06:02.036895 31038 heartbeater.cc:511] Master 127.19.59.126:41385 requested a full tablet report, sending...
I20260812 00:06:02.037082 19693 external_mini_cluster.cc:1428] Setting key 57b92ee9f12df031f44fda3c3e7cf9ed
I20260812 00:06:02.037271 30507 ts_manager.cc:194] Registered new tserver with Master: 5f9f6467ba5b492697587b5ea41ab451 (127.19.59.67:39509)
I20260812 00:06:02.037791 30507 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.59.67:43223
I20260812 00:06:02.038081 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 00:06:02.039827 30556 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:02.039455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39608 (local address 127.19.59.126:41385)
0812 00:06:02.039491 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:02.039493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:02.039574 (+ 81us) server_negotiation.cc:407] Connection header received
0812 00:06:02.039619 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:02.039620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:02.039628 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:02.039690 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:02.039787 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39608: BlockingRecv error: recv got EOF from 127.0.0.1:39608 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:06:02.039896 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 30583
I20260812 00:06:02.053562 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 30734
I20260812 00:06:02.063083 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 30887
I20260812 00:06:02.069558 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 30474
2026-08-12T00:06:02Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (611 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T00:06:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:02Z Disabled control of system clock
I20260812 00:06:02.098788 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:39091
--webserver_interface=127.19.59.126
--webserver_port=0
--builtin_ntp_servers=127.19.59.84:41061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:39091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 00:06:02.182380 31051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:02.182600 31051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:02.182622 31051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:02.183820 31051 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:02.183876 31051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:02.183897 31051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:02.183912 31051 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:02.183967 31051 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:02.185348 31051 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:41061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:39091
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:39091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:02.185623 31051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:02.185956 31051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:06:02.190961 31051 server_base.cc:1034] running on GCE node
W20260812 00:06:02.190932 31063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:02.190944 31058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:02.191002 31061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:02.191453 31051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:02.191788 31051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:02.192950 31051 hybrid_clock.cc:648] HybridClock initialized: now 1786493162192936 us; error 49 us; skew 500 ppm
I20260812 00:06:02.194216 31051 webserver.cc:460] Webserver started at http://127.19.59.126:38989/ using document root <none> and password file <none>
I20260812 00:06:02.194471 31051 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:02.194543 31051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:02.194700 31051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:02.195770 31051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "127debd52f1d4f1486bee81c5b4bda2f"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-6nmv"
server_key: "edba74bc02e537756628e5289038b38b"
server_key_iv: "e93f27f5026c3181a1037d18844855f4"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.196149 31051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "127debd52f1d4f1486bee81c5b4bda2f"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-6nmv"
server_key: "edba74bc02e537756628e5289038b38b"
server_key_iv: "e93f27f5026c3181a1037d18844855f4"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.197460 31051 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:06:02.198253 31069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.198427 31051 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.198540 31051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "127debd52f1d4f1486bee81c5b4bda2f"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-6nmv"
server_key: "edba74bc02e537756628e5289038b38b"
server_key_iv: "e93f27f5026c3181a1037d18844855f4"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.198616 31051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:02.201946 31051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:02.202221 31051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:02.202365 31051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:02.206511 31051 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:39091
I20260812 00:06:02.206548 31128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:39091 every 8 connection(s)
I20260812 00:06:02.206866 31051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:02.207562 31129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:02.210402 31129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f: Bootstrap starting.
I20260812 00:06:02.210971 31129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:02.211308 31129 log.cc:824] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:02.212023 31129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f: No bootstrap required, opened a new log
I20260812 00:06:02.213394 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 31051
I20260812 00:06:02.213505 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:06:02.213745 19693 external_mini_cluster.cc:1428] Setting key c7905e9628cf1d5f4c02cf02ba1299a1
I20260812 00:06:02.214030 31129 raft_consensus.cc:348] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127debd52f1d4f1486bee81c5b4bda2f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 39091 } }
I20260812 00:06:02.214202 31129 raft_consensus.cc:374] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:02.214246 31129 raft_consensus.cc:729] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 127debd52f1d4f1486bee81c5b4bda2f, State: Initialized, Role: FOLLOWER
I20260812 00:06:02.214411 31129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127debd52f1d4f1486bee81c5b4bda2f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 39091 } }
I20260812 00:06:02.214536 31129 raft_consensus.cc:388] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:06:02.214587 31129 raft_consensus.cc:482] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:06:02.214644 31129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:02.215214 31129 raft_consensus.cc:504] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127debd52f1d4f1486bee81c5b4bda2f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 39091 } }
I20260812 00:06:02.215330 31129 leader_election.cc:302] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 127debd52f1d4f1486bee81c5b4bda2f; no voters:
I20260812 00:06:02.215512 31129 leader_election.cc:288] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:06:02.215562 31134 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:02.215695 31134 raft_consensus.cc:686] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [term 1 LEADER]: Becoming Leader. State: Replica: 127debd52f1d4f1486bee81c5b4bda2f, State: Running, Role: LEADER
I20260812 00:06:02.215781 31134 consensus_queue.cc:237] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127debd52f1d4f1486bee81c5b4bda2f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 39091 } }
I20260812 00:06:02.215785 31129 sys_catalog.cc:564] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:02.216322 31133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:02.214311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60296 (local address 127.19.59.126:39091)
0812 00:06:02.214594 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:02.214604 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:02.214637 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:06:02.214746 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:02.214752 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:02.214793 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:02.214921 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:02.215728 (+ 807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:02.215731 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:02.215732 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:02.215736 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:02.215782 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:02.215796 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:02.215844 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:02.216039 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 00:06:02.216095 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":97,"threads_started":1}
I20260812 00:06:02.216367 31135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "127debd52f1d4f1486bee81c5b4bda2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127debd52f1d4f1486bee81c5b4bda2f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 39091 } } }
I20260812 00:06:02.216450 31135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:02.216686 31145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:02.217214 31145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:02.217451 31136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 127debd52f1d4f1486bee81c5b4bda2f. Latest consensus state: current_term: 1 leader_uuid: "127debd52f1d4f1486bee81c5b4bda2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127debd52f1d4f1486bee81c5b4bda2f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 39091 } } }
I20260812 00:06:02.217574 31136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:02.218940 31145 catalog_manager.cc:1347] Generated new cluster ID: 456d8e930b024c3687c8f8965542ae4b
I20260812 00:06:02.219019 31145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:06:02.235311 31145 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:02.235515 31145 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:02.239025 31145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 127debd52f1d4f1486bee81c5b4bda2f: Generated new TSK 0
I20260812 00:06:02.239221 31145 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:06:02.244715 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:39091
--builtin_ntp_servers=127.19.59.84:41061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 00:06:02.341689 31156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:02.341986 31156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:02.342029 31156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:02.343264 31156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:02.343331 31156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:02.343375 31156 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:06:02.344745 31156 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:41061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:39091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:02.345019 31156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:02.345336 31156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:02.350592 31161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:02.350726 31164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:02.350639 31156 server_base.cc:1034] running on GCE node
W20260812 00:06:02.350603 31162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:02.351070 31156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:02.351344 31156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:02.352530 31156 hybrid_clock.cc:648] HybridClock initialized: now 1786493162352503 us; error 42 us; skew 500 ppm
I20260812 00:06:02.354225 31156 webserver.cc:460] Webserver started at http://127.19.59.65:42459/ using document root <none> and password file <none>
I20260812 00:06:02.354491 31156 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:02.354561 31156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:02.354692 31156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:02.356117 31156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "b75b38fa429948d89614662bf0b301df"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-6nmv"
server_key: "35ccd880d0885d170822b2fc834d26e9"
server_key_iv: "1773fc105ff3a38f7e863ca40ae87bcc"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.356513 31156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "b75b38fa429948d89614662bf0b301df"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-6nmv"
server_key: "35ccd880d0885d170822b2fc834d26e9"
server_key_iv: "1773fc105ff3a38f7e863ca40ae87bcc"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.358125 31156 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260812 00:06:02.359038 31170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.359242 31156 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:06:02.359349 31156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "b75b38fa429948d89614662bf0b301df"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-6nmv"
server_key: "35ccd880d0885d170822b2fc834d26e9"
server_key_iv: "1773fc105ff3a38f7e863ca40ae87bcc"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.359428 31156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:02.362725 31156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:02.363000 31156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:02.363148 31156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:02.363358 31156 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:06:02.363655 31156 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:06:02.363710 31156 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.363749 31156 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:06:02.363775 31156 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.369493 31156 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:35381
I20260812 00:06:02.369546 31313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:35381 every 8 connection(s)
I20260812 00:06:02.369980 31156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:06:02.370863 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 31156
I20260812 00:06:02.370975 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:06:02.371179 19693 external_mini_cluster.cc:1428] Setting key 1fe6f2aafaa2773d220898d6a9670cc3
I20260812 00:06:02.372248 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:39091
--builtin_ntp_servers=127.19.59.84:41061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 00:06:02.373437 31133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:02.370813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:42635 (local address 127.19.59.126:39091)
0812 00:06:02.370864 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:02.370866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:02.371189 (+ 323us) server_negotiation.cc:407] Connection header received
0812 00:06:02.371806 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:02.371808 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:02.371815 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:02.371882 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:02.373145 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:02.373147 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:02.373147 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:02.373151 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:02.373167 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:02.373171 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:02.373250 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:02.373344 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 00:06:02.373360 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:06:02.373652 31316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:02.370796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:39091 (local address 127.19.59.65:42635)
0812 00:06:02.371038 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:02.371081 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:02.371695 (+ 614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:02.371990 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:02.371994 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:02.372002 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:02.372983 (+ 981us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:06:02.372984 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:02.373012 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:06:02.373039 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:02.373248 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:02.373255 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:02.373258 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:06:02.373354 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 00:06:02.373414 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":117,"threads_started":1}
I20260812 00:06:02.374214 31314 heartbeater.cc:347] Connected to a master server at 127.19.59.126:39091
I20260812 00:06:02.374310 31314 heartbeater.cc:464] Registering TS with master...
I20260812 00:06:02.374454 31314 heartbeater.cc:511] Master 127.19.59.126:39091 requested a full tablet report, sending...
I20260812 00:06:02.374943 31086 ts_manager.cc:194] Registered new tserver with Master: b75b38fa429948d89614662bf0b301df (127.19.59.65:35381)
W20260812 00:06:02.453243 31317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:02.453501 31317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:02.453539 31317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:02.454707 31317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:02.454775 31317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:02.454818 31317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:06:02.456135 31317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:41061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:39091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:02.456393 31317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:02.456679 31317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:02.461743 31325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:02.461758 31323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:02.461791 31317 server_base.cc:1034] running on GCE node
W20260812 00:06:02.461750 31322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:02.462131 31317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:02.462384 31317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:02.463557 31317 hybrid_clock.cc:648] HybridClock initialized: now 1786493162463539 us; error 32 us; skew 500 ppm
I20260812 00:06:02.464982 31317 webserver.cc:460] Webserver started at http://127.19.59.66:36759/ using document root <none> and password file <none>
I20260812 00:06:02.465222 31317 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:02.465296 31317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:02.465457 31317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:02.466583 31317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "8aacf2150b884ae3ad02fe7bab1c5ab3"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-6nmv"
server_key: "acf571fe01064b7e1371332aeea98e46"
server_key_iv: "c2570086100cca20ca0e3169eac45de5"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.466958 31317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "8aacf2150b884ae3ad02fe7bab1c5ab3"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-6nmv"
server_key: "acf571fe01064b7e1371332aeea98e46"
server_key_iv: "c2570086100cca20ca0e3169eac45de5"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.468356 31317 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:06:02.469338 31332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.469558 31317 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:06:02.469660 31317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "8aacf2150b884ae3ad02fe7bab1c5ab3"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-6nmv"
server_key: "acf571fe01064b7e1371332aeea98e46"
server_key_iv: "c2570086100cca20ca0e3169eac45de5"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.469749 31317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:02.473061 31317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:02.473325 31317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:02.473469 31317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:02.473675 31317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:06:02.474025 31317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:06:02.474082 31317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.474121 31317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:06:02.474148 31317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.479935 31317 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:42617
I20260812 00:06:02.480038 31470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:42617 every 8 connection(s)
I20260812 00:06:02.480324 31317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:06:02.483362 31133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:02.481029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:51287 (local address 127.19.59.126:39091)
0812 00:06:02.481073 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:02.481076 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:02.481303 (+ 227us) server_negotiation.cc:407] Connection header received
0812 00:06:02.481726 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:02.481726 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:02.481731 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:02.481792 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:02.483155 (+ 1363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:02.483157 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:02.483157 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:02.483161 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:02.483180 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:02.483185 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:02.483251 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:02.483298 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 00:06:02.483309 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:06:02.483577 31474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:02.480993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:39091 (local address 127.19.59.66:51287)
0812 00:06:02.481175 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:02.481213 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:02.481647 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:02.481900 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:02.481903 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:02.481910 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:02.482959 (+ 1049us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:06:02.482960 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:02.483002 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:06:02.483044 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:02.483249 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:02.483251 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:02.483254 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:06:02.483303 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:06:02.483350 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":90,"threads_started":1}
I20260812 00:06:02.484097 31471 heartbeater.cc:347] Connected to a master server at 127.19.59.126:39091
I20260812 00:06:02.484194 31471 heartbeater.cc:464] Registering TS with master...
I20260812 00:06:02.484306 31471 heartbeater.cc:511] Master 127.19.59.126:39091 requested a full tablet report, sending...
I20260812 00:06:02.484679 31086 ts_manager.cc:194] Registered new tserver with Master: 8aacf2150b884ae3ad02fe7bab1c5ab3 (127.19.59.66:42617)
I20260812 00:06:02.488003 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 31317
I20260812 00:06:02.488106 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:06:02.488337 19693 external_mini_cluster.cc:1428] Setting key 86df5bd42b2c6154395b1900c483a46c
I20260812 00:06:02.489243 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:39091
--builtin_ntp_servers=127.19.59.84:41061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 00:06:02.570501 31475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:02.570705 31475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:02.570729 31475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:02.571929 31475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:02.571971 31475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:02.572026 31475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:06:02.573526 31475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:41061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:39091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:02.573709 31475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:02.573962 31475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:02.578816 31481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:02.578837 31484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:02.578894 31475 server_base.cc:1034] running on GCE node
W20260812 00:06:02.578923 31482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:02.579306 31475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:02.579517 31475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:02.580693 31475 hybrid_clock.cc:648] HybridClock initialized: now 1786493162580682 us; error 32 us; skew 500 ppm
I20260812 00:06:02.582122 31475 webserver.cc:460] Webserver started at http://127.19.59.67:34173/ using document root <none> and password file <none>
I20260812 00:06:02.582361 31475 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:02.582408 31475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:02.582587 31475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:02.583763 31475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "585d788f1eba4b5d8b09d846d9d10dfa"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-6nmv"
server_key: "f4dd1839fcc55cea5e1bf57d6048dc9d"
server_key_iv: "8010f98a7c45bef6b722a6e44d0648f0"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.584133 31475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "585d788f1eba4b5d8b09d846d9d10dfa"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-6nmv"
server_key: "f4dd1839fcc55cea5e1bf57d6048dc9d"
server_key_iv: "8010f98a7c45bef6b722a6e44d0648f0"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.585431 31475 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:06:02.586236 31491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.586412 31475 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.586503 31475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "585d788f1eba4b5d8b09d846d9d10dfa"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-6nmv"
server_key: "f4dd1839fcc55cea5e1bf57d6048dc9d"
server_key_iv: "8010f98a7c45bef6b722a6e44d0648f0"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.586575 31475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:02.590029 31475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:02.590299 31475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:02.590437 31475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:02.590646 31475 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:06:02.590948 31475 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:06:02.590981 31475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.591037 31475 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:06:02.591055 31475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.596683 31475 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:40993
I20260812 00:06:02.596737 31624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:40993 every 8 connection(s)
I20260812 00:06:02.597033 31475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:06:02.599622 31133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:02.597687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:56439 (local address 127.19.59.126:39091)
0812 00:06:02.597749 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:02.597752 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:02.598000 (+ 248us) server_negotiation.cc:407] Connection header received
0812 00:06:02.598394 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:02.598395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:02.598401 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:02.598450 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:02.599435 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:02.599435 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:02.599436 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:02.599439 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:02.599455 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:02.599471 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:02.599519 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:02.599560 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 00:06:02.599571 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:06:02.599786 31628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:02.597674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:39091 (local address 127.19.59.67:56439)
0812 00:06:02.597884 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:02.597925 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:02.598317 (+ 392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:02.598492 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:02.598495 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:02.598502 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:02.599308 (+ 806us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:06:02.599308 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:02.599332 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:06:02.599358 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:02.599518 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:02.599519 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:02.599521 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:06:02.599567 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 00:06:02.599610 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":95,"threads_started":1}
I20260812 00:06:02.600391 31625 heartbeater.cc:347] Connected to a master server at 127.19.59.126:39091
I20260812 00:06:02.600490 31625 heartbeater.cc:464] Registering TS with master...
I20260812 00:06:02.600626 31625 heartbeater.cc:511] Master 127.19.59.126:39091 requested a full tablet report, sending...
I20260812 00:06:02.600989 31086 ts_manager.cc:194] Registered new tserver with Master: 585d788f1eba4b5d8b09d846d9d10dfa (127.19.59.67:40993)
I20260812 00:06:02.604413 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 31475
I20260812 00:06:02.604503 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:06:02.604671 19693 external_mini_cluster.cc:1428] Setting key def73213d6ef76c07431df574a62f6b7
I20260812 00:06:02.606060 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 00:06:02.608090 31133 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:02.607649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60310 (local address 127.19.59.126:39091)
0812 00:06:02.607707 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:02.607709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:02.607817 (+ 108us) server_negotiation.cc:407] Connection header received
0812 00:06:02.607861 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:02.607862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:02.607865 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:02.607909 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:02.608036 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60310: BlockingRecv error: recv got EOF from 127.0.0.1:60310 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:06:02.608144 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 31156
I20260812 00:06:02.622341 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 31317
I20260812 00:06:02.634972 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 31475
I20260812 00:06:02.645246 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 31051
2026-08-12T00:06:02Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (576 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:06:02 dist-test-slave-6nmv krb5kdc[31637](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:06:02 dist-test-slave-6nmv krb5kdc[31637](info): set up 2 sockets
Aug 12 00:06:02 dist-test-slave-6nmv krb5kdc[31637](info): commencing operation
krb5kdc: starting...
W20260812 00:06:03.733120 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:06:03 dist-test-slave-6nmv krb5kdc[31637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493163, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:06:03.848332 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:46065
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:39969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:46065
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:03.922297 31650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:03.922506 31650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:03.922528 31650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:03.923514 31650 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:03.923543 31650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:03.923555 31650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:03.923566 31650 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:03.923576 31650 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:03.924817 31650 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:39969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:46065
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:46065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:03.924990 31650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:03.925148 31650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:03.929541 31658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:03.929617 31655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:03.929570 31656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:03.929682 31650 server_base.cc:1034] running on GCE node
I20260812 00:06:03.929988 31650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:03.930248 31650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:03.931402 31650 hybrid_clock.cc:648] HybridClock initialized: now 1786493163931381 us; error 37 us; skew 500 ppm
Aug 12 00:06:03 dist-test-slave-6nmv krb5kdc[31637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493163, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:03.933785 31650 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:06:03.934211 31650 webserver.cc:460] Webserver started at http://127.19.59.126:46123/ using document root <none> and password file <none>
I20260812 00:06:03.934413 31650 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:03.934453 31650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:03.934583 31650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:03.935415 31650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "629c3b2fe5614aacb10671824ef71631"
format_stamp: "Formatted at 2026-08-12 00:06:03 on dist-test-slave-6nmv"
server_key: "89696ec5274bd7d60b7fc3848ce755e9"
server_key_iv: "e1a14b9eddf1e612e624aae51cfaa67c"
server_key_version: "encryptionkey@0"
I20260812 00:06:03.935722 31650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "629c3b2fe5614aacb10671824ef71631"
format_stamp: "Formatted at 2026-08-12 00:06:03 on dist-test-slave-6nmv"
server_key: "89696ec5274bd7d60b7fc3848ce755e9"
server_key_iv: "e1a14b9eddf1e612e624aae51cfaa67c"
server_key_version: "encryptionkey@0"
I20260812 00:06:03.936966 31650 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:06:03.937637 31666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:03.937901 31650 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:06:03.937999 31650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "629c3b2fe5614aacb10671824ef71631"
format_stamp: "Formatted at 2026-08-12 00:06:03 on dist-test-slave-6nmv"
server_key: "89696ec5274bd7d60b7fc3848ce755e9"
server_key_iv: "e1a14b9eddf1e612e624aae51cfaa67c"
server_key_version: "encryptionkey@0"
I20260812 00:06:03.938086 31650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:03.956310 31650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:03.958689 31650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:03.958841 31650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:03.962877 31650 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:46065
I20260812 00:06:03.962918 31730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:46065 every 8 connection(s)
I20260812 00:06:03.963265 31650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:03.964182 31731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:03.966503 31731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631: Bootstrap starting.
I20260812 00:06:03.967072 31731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:03.967370 31731 log.cc:824] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:03.968138 31731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631: No bootstrap required, opened a new log
I20260812 00:06:03.969623 31731 raft_consensus.cc:348] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629c3b2fe5614aacb10671824ef71631" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46065 } }
I20260812 00:06:03.969751 31731 raft_consensus.cc:374] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:03.969774 31731 raft_consensus.cc:729] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629c3b2fe5614aacb10671824ef71631, State: Initialized, Role: FOLLOWER
I20260812 00:06:03.969937 31731 consensus_queue.cc:260] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629c3b2fe5614aacb10671824ef71631" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46065 } }
I20260812 00:06:03.970014 31731 raft_consensus.cc:388] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:06:03.970037 31731 raft_consensus.cc:482] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:06:03.970086 31731 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:03.970883 31731 raft_consensus.cc:504] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629c3b2fe5614aacb10671824ef71631" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46065 } }
I20260812 00:06:03.970978 31731 leader_election.cc:302] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 629c3b2fe5614aacb10671824ef71631; no voters:
I20260812 00:06:03.971194 31731 leader_election.cc:288] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:06:03.971280 31734 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:03.971450 31734 raft_consensus.cc:686] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [term 1 LEADER]: Becoming Leader. State: Replica: 629c3b2fe5614aacb10671824ef71631, State: Running, Role: LEADER
I20260812 00:06:03.971477 31731 sys_catalog.cc:564] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:03.971536 31734 consensus_queue.cc:237] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629c3b2fe5614aacb10671824ef71631" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46065 } }
I20260812 00:06:03.971949 31736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "629c3b2fe5614aacb10671824ef71631" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629c3b2fe5614aacb10671824ef71631" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46065 } } }
I20260812 00:06:03.971988 31738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 629c3b2fe5614aacb10671824ef71631. Latest consensus state: current_term: 1 leader_uuid: "629c3b2fe5614aacb10671824ef71631" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629c3b2fe5614aacb10671824ef71631" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46065 } } }
I20260812 00:06:03.972157 31738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:03.972137 31736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:03.972541 31746 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:03.972610 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 31650
I20260812 00:06:03.972708 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:06:03.972935 19693 external_mini_cluster.cc:1428] Setting key a34344ef0d61fdfc2155e9aea6cd7fc3
I20260812 00:06:03.973088 31746 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:03.975364 31746 catalog_manager.cc:1347] Generated new cluster ID: 99911554e8634a278ddf68dad19d3215
I20260812 00:06:03.975414 31746 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:06:03 dist-test-slave-6nmv krb5kdc[31637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493163, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:06:03.984362 31758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:03.973611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46156 (local address 127.19.59.126:46065)
0812 00:06:03.973763 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:03.973771 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:03.973828 (+ 57us) server_negotiation.cc:407] Connection header received
0812 00:06:03.973937 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:03.973952 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:03.974011 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:03.974148 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:03.974759 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:03.976047 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:03.977169 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:03.977772 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:03.977890 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:03.980626 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:03.980630 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:03.980630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:03.980642 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:03.982675 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:03.983057 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:03.983060 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:03.983060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:03.983192 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:03.983383 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:03.983384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:03.983384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:03.983695 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:03.983861 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:03.983927 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 00:06:03.984157 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":71,"threads_started":1}
I20260812 00:06:03.995085 31746 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:03.995772 31746 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:04.003779 31746 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631: Generated new TSK 0
I20260812 00:06:04.003963 31746 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:06:04.033519 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46065
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:39969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:04.112337 31762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:04.112533 31762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:04.112555 31762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:04.113674 31762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:04.113716 31762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:04.113742 31762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:06:04.115175 31762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:39969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31762
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:04.115404 31762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:04.115645 31762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:04.120651 31770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:04.120641 31768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:04.120713 31762 server_base.cc:1034] running on GCE node
W20260812 00:06:04.120639 31767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:04.121078 31762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:04.121351 31762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:04.122524 31762 hybrid_clock.cc:648] HybridClock initialized: now 1786493164122510 us; error 26 us; skew 500 ppm
Aug 12 00:06:04 dist-test-slave-6nmv krb5kdc[31637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493164, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:04.125095 31762 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:06:04.125530 31762 webserver.cc:460] Webserver started at http://127.19.59.65:33533/ using document root <none> and password file <none>
I20260812 00:06:04.125751 31762 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:04.125845 31762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:04.126008 31762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:04.127118 31762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "7920ad9361024fee82c0b421b7bf3e55"
format_stamp: "Formatted at 2026-08-12 00:06:04 on dist-test-slave-6nmv"
server_key: "614b3a81dde1d0128a57da4740a2e813"
server_key_iv: "f77874203a1bb157fdcc68f065cc8d31"
server_key_version: "encryptionkey@0"
I20260812 00:06:04.127473 31762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "7920ad9361024fee82c0b421b7bf3e55"
format_stamp: "Formatted at 2026-08-12 00:06:04 on dist-test-slave-6nmv"
server_key: "614b3a81dde1d0128a57da4740a2e813"
server_key_iv: "f77874203a1bb157fdcc68f065cc8d31"
server_key_version: "encryptionkey@0"
I20260812 00:06:04.128808 31762 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:06:04.129498 31777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:04.129681 31762 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:06:04.129781 31762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "7920ad9361024fee82c0b421b7bf3e55"
format_stamp: "Formatted at 2026-08-12 00:06:04 on dist-test-slave-6nmv"
server_key: "614b3a81dde1d0128a57da4740a2e813"
server_key_iv: "f77874203a1bb157fdcc68f065cc8d31"
server_key_version: "encryptionkey@0"
I20260812 00:06:04.129907 31762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:04.138098 31762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:04.140098 31762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:04.140264 31762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:04.140486 31762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:06:04.140772 31762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:06:04.140852 31762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:04.140899 31762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:06:04.140926 31762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:04.146790 31762 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:45879
I20260812 00:06:04.146844 31908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:45879 every 8 connection(s)
I20260812 00:06:04.147158 31762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:06:04.148492 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 31762
I20260812 00:06:04.148599 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:06:04.148821 19693 external_mini_cluster.cc:1428] Setting key 4b6110abf7cbfa38a07df06d6a88c239
Aug 12 00:06:04 dist-test-slave-6nmv krb5kdc[31637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493164, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
I20260812 00:06:04.157471 31758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.147946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:34311 (local address 127.19.59.126:46065)
0812 00:06:04.148034 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:04.148037 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:04.148197 (+ 160us) server_negotiation.cc:407] Connection header received
0812 00:06:04.148777 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:04.148778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:04.148795 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:04.148851 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:04.150206 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.150711 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.151966 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.152186 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.152261 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.154537 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:04.154539 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:04.154539 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:04.154547 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:04.156008 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:04.156439 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:04.156440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:04.156440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:04.156499 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:04.156757 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:04.156758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:04.156758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:04.156874 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:04.156950 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:04.157259 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 00:06:04.157365 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 00:06:04.157617 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.147874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:46065 (local address 127.19.59.65:34311)
0812 00:06:04.148065 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:04.148111 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:04.148645 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:04.148926 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:04.148929 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:04.149785 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:04.150100 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.150106 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.150796 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.150797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.151853 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.151856 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.152269 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.152270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.152403 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.152937 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:04.152945 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:04.154442 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:04.156109 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:04.156117 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:04.156119 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:04.156347 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:04.156565 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:04.156566 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:04.156566 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:04.156685 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:04.156942 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:04.156949 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:04.157117 (+ 168us) client_negotiation.cc:769] Sending connection context
0812 00:06:04.157236 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 00:06:04.157392 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":97,"threads_started":1}
I20260812 00:06:04.158154 31909 heartbeater.cc:347] Connected to a master server at 127.19.59.126:46065
I20260812 00:06:04.158263 31909 heartbeater.cc:464] Registering TS with master...
I20260812 00:06:04.158474 31909 heartbeater.cc:511] Master 127.19.59.126:46065 requested a full tablet report, sending...
I20260812 00:06:04.159080 31686 ts_manager.cc:194] Registered new tserver with Master: 7920ad9361024fee82c0b421b7bf3e55 (127.19.59.65:45879)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
I20260812 00:06:04.159772 31686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:34311
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:06:04.176862 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46065
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:39969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:04.255316 31915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:04.255510 31915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:04.255533 31915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:04.256675 31915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:04.256717 31915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:04.256743 31915 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:06:04.258169 31915 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:39969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:04.258335 31915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:04.258566 31915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:04.263314 31925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:04.263309 31921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:04.263309 31922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:04.263442 31915 server_base.cc:1034] running on GCE node
I20260812 00:06:04.263721 31915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:04.263914 31915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:04.265053 31915 hybrid_clock.cc:648] HybridClock initialized: now 1786493164265026 us; error 40 us; skew 500 ppm
Aug 12 00:06:04 dist-test-slave-6nmv krb5kdc[31637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493164, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:04.267582 31915 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:06:04.267927 31915 webserver.cc:460] Webserver started at http://127.19.59.66:44929/ using document root <none> and password file <none>
I20260812 00:06:04.268112 31915 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:04.268148 31915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:04.268272 31915 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:04.269177 31915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "db365a8b95e44ba09d09a51d99c951da"
format_stamp: "Formatted at 2026-08-12 00:06:04 on dist-test-slave-6nmv"
server_key: "9b6b743f6c0091c4006e4a067d2a21db"
server_key_iv: "dce379a9271ebde0f4317a7d58447854"
server_key_version: "encryptionkey@0"
I20260812 00:06:04.269539 31915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "db365a8b95e44ba09d09a51d99c951da"
format_stamp: "Formatted at 2026-08-12 00:06:04 on dist-test-slave-6nmv"
server_key: "9b6b743f6c0091c4006e4a067d2a21db"
server_key_iv: "dce379a9271ebde0f4317a7d58447854"
server_key_version: "encryptionkey@0"
I20260812 00:06:04.270857 31915 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:06:04.271580 31932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:04.271822 31915 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:06:04.271924 31915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "db365a8b95e44ba09d09a51d99c951da"
format_stamp: "Formatted at 2026-08-12 00:06:04 on dist-test-slave-6nmv"
server_key: "9b6b743f6c0091c4006e4a067d2a21db"
server_key_iv: "dce379a9271ebde0f4317a7d58447854"
server_key_version: "encryptionkey@0"
I20260812 00:06:04.272009 31915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:04.283830 31915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:04.285295 31915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:04.285431 31915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:04.285619 31915 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:06:04.285945 31915 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:06:04.286000 31915 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:04.286041 31915 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:06:04.286067 31915 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:04.291491 31915 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:46681
I20260812 00:06:04.291558 32068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:46681 every 8 connection(s)
I20260812 00:06:04.291872 31915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:06:04 dist-test-slave-6nmv krb5kdc[31637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493164, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:06:04.300411 31758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.292501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:58851 (local address 127.19.59.126:46065)
0812 00:06:04.292544 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:04.292547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:04.292720 (+ 173us) server_negotiation.cc:407] Connection header received
0812 00:06:04.293200 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:04.293201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:04.293215 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:04.293266 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:04.294133 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.294574 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.295460 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.295637 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.295715 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.297762 (+ 2047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:04.297764 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:04.297764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:04.297772 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:04.299128 (+ 1356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:04.299531 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:04.299532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:04.299532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:04.299589 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:04.299811 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:04.299812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:04.299812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:04.299922 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:04.299985 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:04.300239 (+ 254us) server_negotiation.cc:299] Negotiation successful
0812 00:06:04.300317 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:06:04.300585 32071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.292466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:46065 (local address 127.19.59.66:58851)
0812 00:06:04.292597 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:04.292640 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:04.293093 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:04.293321 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:04.293324 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:04.293857 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:04.294025 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.294040 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.294661 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.294662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.295365 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.295367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.295724 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.295725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.295856 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.296347 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:04.296354 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:04.297663 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:04.299223 (+ 1560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:04.299230 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:04.299231 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:04.299438 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:04.299647 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:04.299648 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:04.299648 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:04.299746 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:04.299987 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:04.299993 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:04.300110 (+ 117us) client_negotiation.cc:769] Sending connection context
0812 00:06:04.300218 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 00:06:04.300351 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":62,"threads_started":1}
I20260812 00:06:04.301047 32069 heartbeater.cc:347] Connected to a master server at 127.19.59.126:46065
I20260812 00:06:04.301120 32069 heartbeater.cc:464] Registering TS with master...
I20260812 00:06:04.301304 32069 heartbeater.cc:511] Master 127.19.59.126:46065 requested a full tablet report, sending...
I20260812 00:06:04.301666 31686 ts_manager.cc:194] Registered new tserver with Master: db365a8b95e44ba09d09a51d99c951da (127.19.59.66:46681)
I20260812 00:06:04.301930 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 31915
I20260812 00:06:04.302052 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:06:04.302170 31686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:58851
I20260812 00:06:04.302223 19693 external_mini_cluster.cc:1428] Setting key b1415e15462abbee2a44602c57000bf1
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:06:04.328568 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46065
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:39969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:04.406965 32074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:04.407177 32074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:04.407199 32074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:04.408296 32074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:04.408334 32074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:04.408356 32074 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:06:04.409652 32074 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:39969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:04.409924 32074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:04.410142 32074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:04.414948 32079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:04.414898 32080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:04.415066 32074 server_base.cc:1034] running on GCE node
W20260812 00:06:04.415143 32082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:04.415323 32074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:04.415556 32074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:04.416693 32074 hybrid_clock.cc:648] HybridClock initialized: now 1786493164416677 us; error 32 us; skew 500 ppm
Aug 12 00:06:04 dist-test-slave-6nmv krb5kdc[31637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493164, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:04.419008 32074 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:06:04.419382 32074 webserver.cc:460] Webserver started at http://127.19.59.67:34203/ using document root <none> and password file <none>
I20260812 00:06:04.419585 32074 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:04.419627 32074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:04.419762 32074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:04.420674 32074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "f1fd8c470f9142e2b3da581852b72332"
format_stamp: "Formatted at 2026-08-12 00:06:04 on dist-test-slave-6nmv"
server_key: "b85c193bdd50996f6c52bb05e62347cc"
server_key_iv: "4189c80c2ac868de09696db0db9975de"
server_key_version: "encryptionkey@0"
I20260812 00:06:04.421012 32074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "f1fd8c470f9142e2b3da581852b72332"
format_stamp: "Formatted at 2026-08-12 00:06:04 on dist-test-slave-6nmv"
server_key: "b85c193bdd50996f6c52bb05e62347cc"
server_key_iv: "4189c80c2ac868de09696db0db9975de"
server_key_version: "encryptionkey@0"
I20260812 00:06:04.422322 32074 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:06:04.423092 32091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:04.423273 32074 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:06:04.423365 32074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "f1fd8c470f9142e2b3da581852b72332"
format_stamp: "Formatted at 2026-08-12 00:06:04 on dist-test-slave-6nmv"
server_key: "b85c193bdd50996f6c52bb05e62347cc"
server_key_iv: "4189c80c2ac868de09696db0db9975de"
server_key_version: "encryptionkey@0"
I20260812 00:06:04.423439 32074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:04.465936 32074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:04.467865 32074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:04.468026 32074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:04.468299 32074 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:06:04.468621 32074 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:06:04.468683 32074 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:04.468711 32074 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:06:04.468725 32074 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:04.475117 32074 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:38561
I20260812 00:06:04.475201 32225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:38561 every 8 connection(s)
I20260812 00:06:04.475493 32074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:06:04 dist-test-slave-6nmv krb5kdc[31637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493164, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:06:04.483686 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 32074
I20260812 00:06:04.483819 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:06:04.484063 19693 external_mini_cluster.cc:1428] Setting key 92763311f77ab3454678912fcc096de6
I20260812 00:06:04.484558 31758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.476280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:54149 (local address 127.19.59.126:46065)
0812 00:06:04.476346 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:04.476348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:04.476562 (+ 214us) server_negotiation.cc:407] Connection header received
0812 00:06:04.477110 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:04.477112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:04.477125 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:04.477182 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:04.478133 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.478609 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.479497 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.479695 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.479774 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.481776 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:04.481778 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:04.481778 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:04.481784 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:04.483015 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:04.483365 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:04.483366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:04.483366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:04.483435 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:04.483761 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:04.483762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:04.483762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:04.483926 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:04.483983 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:04.484339 (+ 356us) server_negotiation.cc:299] Negotiation successful
0812 00:06:04.484452 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 00:06:04.485011 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.476254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:46065 (local address 127.19.59.67:54149)
0812 00:06:04.476439 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:04.476478 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:04.476996 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:04.477248 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:04.477252 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:04.477796 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:04.478041 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.478046 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.478700 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.478700 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.479408 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.479410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.479785 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.479786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.479895 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.480331 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:04.480338 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:04.481696 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:04.483086 (+ 1390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:04.483092 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:04.483094 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:04.483303 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:04.483521 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:04.483522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:04.483522 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:04.483667 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:04.483983 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:04.483990 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:04.484155 (+ 165us) client_negotiation.cc:769] Sending connection context
0812 00:06:04.484669 (+ 514us) client_negotiation.cc:240] Negotiation successful
0812 00:06:04.484836 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":92,"threads_started":1}
I20260812 00:06:04.485602 32226 heartbeater.cc:347] Connected to a master server at 127.19.59.126:46065
I20260812 00:06:04.485715 32226 heartbeater.cc:464] Registering TS with master...
I20260812 00:06:04.485915 32226 heartbeater.cc:511] Master 127.19.59.126:46065 requested a full tablet report, sending...
I20260812 00:06:04.486310 31686 ts_manager.cc:194] Registered new tserver with Master: f1fd8c470f9142e2b3da581852b72332 (127.19.59.67:38561)
I20260812 00:06:04.486670 31686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:54149
I20260812 00:06:04.495965 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:06:04.503192 31758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.497278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46164 (local address 127.19.59.126:46065)
0812 00:06:04.497355 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:04.497357 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:04.497445 (+ 88us) server_negotiation.cc:407] Connection header received
0812 00:06:04.497525 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:04.497525 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:04.497535 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:04.497604 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:04.498235 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.498700 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.499434 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.499650 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.499724 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.500832 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:04.500833 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:04.500834 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:04.500842 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:04.502032 (+ 1190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:04.502372 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:04.502373 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:04.502373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:04.502429 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:04.502631 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:04.502632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:04.502632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:04.502773 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:04.502880 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:04.503004 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 00:06:04.503087 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 00:06:04.504956 31686 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46164:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:06:04.506620 31686 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:06:04.513330 32240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.509064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:45879 (local address 127.0.0.1:59448)
0812 00:06:04.509244 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:04.509289 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:04.509357 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:04.509761 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:04.509764 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:04.509766 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:06:04.509855 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.509857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.511204 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.511205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.512320 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.512322 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.512985 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.512986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.513073 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.513106 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 00:06:04.513182 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 00:06:04.513235 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":32,"thread_start_us":49,"threads_started":1}
I20260812 00:06:04.513337 32239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.509075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:46681 (local address 127.0.0.1:50196)
0812 00:06:04.509525 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:04.509537 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:04.509702 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:04.510064 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:04.510065 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:04.510067 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:06:04.510111 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.510113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.510986 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.510987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.512272 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.512275 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.512989 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.512990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.513075 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.513107 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 00:06:04.513196 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 00:06:04.513242 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"mutex_wait_us":1,"thread_start_us":103,"threads_started":1}
I20260812 00:06:04.513345 32244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.509343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59448 (local address 127.19.59.65:45879)
0812 00:06:04.509536 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:04.509541 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:04.509554 (+ 13us) server_negotiation.cc:407] Connection header received
0812 00:06:04.509596 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:04.509598 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:04.509616 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:04.509704 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:06:04.509941 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.511100 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.512413 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.512894 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.512982 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.513050 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:04.513208 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 00:06:04.513254 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":124,"threads_started":1}
I20260812 00:06:04.514432 32243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.509325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53704 (local address 127.19.59.67:38561)
0812 00:06:04.509606 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:04.509610 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:04.509620 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:06:04.509656 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:04.509658 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:04.509672 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:04.509743 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:06:04.510235 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.511247 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.513076 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.514049 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.514119 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.514172 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:04.514325 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 00:06:04.514376 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":107,"threads_started":1}
I20260812 00:06:04.514443 32241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.509067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:38561 (local address 127.0.0.1:53704)
0812 00:06:04.509525 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:04.509537 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:04.509594 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:04.510107 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:04.510108 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:04.510110 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:06:04.510168 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.510170 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.511342 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.511343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.512285 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.512288 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.514175 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.514176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.514248 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.514251 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:06:04.514313 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 00:06:04.514369 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":2,"thread_start_us":129,"threads_started":1}
I20260812 00:06:04.514434 31832 tablet_service.cc:1467] Processing CreateTablet for tablet fb7b0b3fb7144aac9fc41a124370a7a6 (DEFAULT_TABLE table=test-table [id=4759ed1ec2ac4a8bb28f0172be7cadef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:06:04.514793 31832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb7b0b3fb7144aac9fc41a124370a7a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:04.515086 32145 tablet_service.cc:1467] Processing CreateTablet for tablet fb7b0b3fb7144aac9fc41a124370a7a6 (DEFAULT_TABLE table=test-table [id=4759ed1ec2ac4a8bb28f0172be7cadef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:06:04.515388 32145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb7b0b3fb7144aac9fc41a124370a7a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:04.517582 32242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.509328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50196 (local address 127.19.59.66:46681)
0812 00:06:04.509907 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:04.509912 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:04.509921 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:06:04.509957 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:04.509961 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:04.509979 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:04.510044 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:06:04.510199 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.510887 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.512371 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.512894 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.512978 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.513040 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:04.513750 (+ 710us) server_negotiation.cc:299] Negotiation successful
0812 00:06:04.513802 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":107,"threads_started":1}
I20260812 00:06:04.517599 32245 tablet_bootstrap.cc:492] T fb7b0b3fb7144aac9fc41a124370a7a6 P 7920ad9361024fee82c0b421b7bf3e55: Bootstrap starting.
I20260812 00:06:04.518276 31988 tablet_service.cc:1467] Processing CreateTablet for tablet fb7b0b3fb7144aac9fc41a124370a7a6 (DEFAULT_TABLE table=test-table [id=4759ed1ec2ac4a8bb28f0172be7cadef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:06:04.518486 32245 tablet_bootstrap.cc:654] T fb7b0b3fb7144aac9fc41a124370a7a6 P 7920ad9361024fee82c0b421b7bf3e55: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:04.518610 31988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb7b0b3fb7144aac9fc41a124370a7a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:04.519062 32245 log.cc:824] T fb7b0b3fb7144aac9fc41a124370a7a6 P 7920ad9361024fee82c0b421b7bf3e55: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:04.519840 32245 tablet_bootstrap.cc:492] T fb7b0b3fb7144aac9fc41a124370a7a6 P 7920ad9361024fee82c0b421b7bf3e55: No bootstrap required, opened a new log
I20260812 00:06:04.519914 32245 ts_tablet_manager.cc:1397] T fb7b0b3fb7144aac9fc41a124370a7a6 P 7920ad9361024fee82c0b421b7bf3e55: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:06:04.521886 32247 tablet_bootstrap.cc:492] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da: Bootstrap starting.
I20260812 00:06:04.521996 32245 raft_consensus.cc:348] T fb7b0b3fb7144aac9fc41a124370a7a6 P 7920ad9361024fee82c0b421b7bf3e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7920ad9361024fee82c0b421b7bf3e55" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45879 } } peers { permanent_uuid: "f1fd8c470f9142e2b3da581852b72332" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38561 } } peers { permanent_uuid: "db365a8b95e44ba09d09a51d99c951da" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 46681 } }
I20260812 00:06:04.522161 32245 raft_consensus.cc:374] T fb7b0b3fb7144aac9fc41a124370a7a6 P 7920ad9361024fee82c0b421b7bf3e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:04.522205 32245 raft_consensus.cc:729] T fb7b0b3fb7144aac9fc41a124370a7a6 P 7920ad9361024fee82c0b421b7bf3e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7920ad9361024fee82c0b421b7bf3e55, State: Initialized, Role: FOLLOWER
I20260812 00:06:04.522343 32245 consensus_queue.cc:260] T fb7b0b3fb7144aac9fc41a124370a7a6 P 7920ad9361024fee82c0b421b7bf3e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7920ad9361024fee82c0b421b7bf3e55" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45879 } } peers { permanent_uuid: "f1fd8c470f9142e2b3da581852b72332" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38561 } } peers { permanent_uuid: "db365a8b95e44ba09d09a51d99c951da" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 46681 } }
I20260812 00:06:04.522637 32245 ts_tablet_manager.cc:1428] T fb7b0b3fb7144aac9fc41a124370a7a6 P 7920ad9361024fee82c0b421b7bf3e55: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 00:06:04.522665 31909 heartbeater.cc:503] Master 127.19.59.126:46065 was elected leader, sending a full tablet report...
I20260812 00:06:04.522745 32247 tablet_bootstrap.cc:654] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:04.522820 32248 tablet_bootstrap.cc:492] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332: Bootstrap starting.
I20260812 00:06:04.523352 32248 tablet_bootstrap.cc:654] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:04.523340 32247 log.cc:824] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:04.523949 32248 log.cc:824] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:04.524152 32247 tablet_bootstrap.cc:492] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da: No bootstrap required, opened a new log
I20260812 00:06:04.524230 32247 ts_tablet_manager.cc:1397] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:06:04.524677 32248 tablet_bootstrap.cc:492] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332: No bootstrap required, opened a new log
I20260812 00:06:04.524725 32248 ts_tablet_manager.cc:1397] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:06:04.525905 32247 raft_consensus.cc:348] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7920ad9361024fee82c0b421b7bf3e55" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45879 } } peers { permanent_uuid: "f1fd8c470f9142e2b3da581852b72332" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38561 } } peers { permanent_uuid: "db365a8b95e44ba09d09a51d99c951da" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 46681 } }
I20260812 00:06:04.526041 32247 raft_consensus.cc:374] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:04.526085 32247 raft_consensus.cc:729] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db365a8b95e44ba09d09a51d99c951da, State: Initialized, Role: FOLLOWER
I20260812 00:06:04.526191 32247 consensus_queue.cc:260] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7920ad9361024fee82c0b421b7bf3e55" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45879 } } peers { permanent_uuid: "f1fd8c470f9142e2b3da581852b72332" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38561 } } peers { permanent_uuid: "db365a8b95e44ba09d09a51d99c951da" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 46681 } }
I20260812 00:06:04.526197 32248 raft_consensus.cc:348] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7920ad9361024fee82c0b421b7bf3e55" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45879 } } peers { permanent_uuid: "f1fd8c470f9142e2b3da581852b72332" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38561 } } peers { permanent_uuid: "db365a8b95e44ba09d09a51d99c951da" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 46681 } }
I20260812 00:06:04.526351 32248 raft_consensus.cc:374] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:04.526393 32248 raft_consensus.cc:729] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1fd8c470f9142e2b3da581852b72332, State: Initialized, Role: FOLLOWER
I20260812 00:06:04.526475 32247 ts_tablet_manager.cc:1428] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:06:04.526533 32069 heartbeater.cc:503] Master 127.19.59.126:46065 was elected leader, sending a full tablet report...
I20260812 00:06:04.526543 32248 consensus_queue.cc:260] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7920ad9361024fee82c0b421b7bf3e55" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45879 } } peers { permanent_uuid: "f1fd8c470f9142e2b3da581852b72332" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38561 } } peers { permanent_uuid: "db365a8b95e44ba09d09a51d99c951da" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 46681 } }
I20260812 00:06:04.526799 32248 ts_tablet_manager.cc:1428] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:06:04.527074 32226 heartbeater.cc:503] Master 127.19.59.126:46065 was elected leader, sending a full tablet report...
W20260812 00:06:04.542349 32070 tablet.cc:2369] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:06:04.633783 32254 raft_consensus.cc:482] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:06:04.633983 32254 raft_consensus.cc:504] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7920ad9361024fee82c0b421b7bf3e55" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45879 } } peers { permanent_uuid: "f1fd8c470f9142e2b3da581852b72332" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38561 } } peers { permanent_uuid: "db365a8b95e44ba09d09a51d99c951da" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 46681 } }
I20260812 00:06:04.634419 32254 leader_election.cc:288] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7920ad9361024fee82c0b421b7bf3e55 (127.19.59.65:45879), f1fd8c470f9142e2b3da581852b72332 (127.19.59.67:38561)
I20260812 00:06:04.637084 32071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.634589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:45879 (local address 127.19.59.66:46611)
0812 00:06:04.634642 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:04.634652 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:04.634694 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:04.634862 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:04.634863 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:04.634865 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:06:04.634937 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.634939 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.635519 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.635520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.636242 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.636244 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.636798 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.636799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.636884 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.636887 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:06:04.636965 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 00:06:04.637008 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 00:06:04.637084 32244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.634651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:46611 (local address 127.19.59.65:45879)
0812 00:06:04.634701 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:04.634703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:04.634732 (+ 29us) server_negotiation.cc:407] Connection header received
0812 00:06:04.634759 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:04.634760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:04.634767 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:04.634844 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:06:04.635001 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.635440 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.636341 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.636713 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.636800 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.636809 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:04.636974 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 00:06:04.637010 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:06:04.637216 32243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.634651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:54971 (local address 127.19.59.67:38561)
0812 00:06:04.634717 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:04.634719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:04.634868 (+ 149us) server_negotiation.cc:407] Connection header received
0812 00:06:04.634932 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:04.634933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:04.634942 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:04.635010 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:06:04.635161 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.635578 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.636449 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.636830 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.636911 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.636919 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:04.637074 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 00:06:04.637130 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 00:06:04.637401 32256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.634602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:38561 (local address 127.19.59.66:54971)
0812 00:06:04.634782 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:04.634797 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:04.634882 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:04.635026 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:04.635027 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:04.635028 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:06:04.635098 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.635100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.635651 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.635652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.636358 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:04.636360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.636911 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.636912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:04.636987 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.636990 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:06:04.637065 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:06:04.637123 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":118,"threads_started":1}
I20260812 00:06:04.637428 31854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb7b0b3fb7144aac9fc41a124370a7a6" candidate_uuid: "db365a8b95e44ba09d09a51d99c951da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7920ad9361024fee82c0b421b7bf3e55" is_pre_election: true
I20260812 00:06:04.637612 31854 raft_consensus.cc:2454] T fb7b0b3fb7144aac9fc41a124370a7a6 P 7920ad9361024fee82c0b421b7bf3e55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db365a8b95e44ba09d09a51d99c951da in term 0.
I20260812 00:06:04.637768 32169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb7b0b3fb7144aac9fc41a124370a7a6" candidate_uuid: "db365a8b95e44ba09d09a51d99c951da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1fd8c470f9142e2b3da581852b72332" is_pre_election: true
I20260812 00:06:04.637852 31933 leader_election.cc:302] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7920ad9361024fee82c0b421b7bf3e55, db365a8b95e44ba09d09a51d99c951da; no voters:
I20260812 00:06:04.637964 32169 raft_consensus.cc:2454] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db365a8b95e44ba09d09a51d99c951da in term 0.
I20260812 00:06:04.637975 32254 raft_consensus.cc:2781] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:06:04.638023 32254 raft_consensus.cc:482] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:06:04.638052 32254 raft_consensus.cc:3037] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:04.638756 32254 raft_consensus.cc:504] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7920ad9361024fee82c0b421b7bf3e55" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45879 } } peers { permanent_uuid: "f1fd8c470f9142e2b3da581852b72332" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38561 } } peers { permanent_uuid: "db365a8b95e44ba09d09a51d99c951da" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 46681 } }
I20260812 00:06:04.638985 32254 leader_election.cc:288] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [CANDIDATE]: Term 1 election: Requested vote from peers 7920ad9361024fee82c0b421b7bf3e55 (127.19.59.65:45879), f1fd8c470f9142e2b3da581852b72332 (127.19.59.67:38561)
I20260812 00:06:04.639071 31854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb7b0b3fb7144aac9fc41a124370a7a6" candidate_uuid: "db365a8b95e44ba09d09a51d99c951da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7920ad9361024fee82c0b421b7bf3e55"
I20260812 00:06:04.639166 31854 raft_consensus.cc:3037] T fb7b0b3fb7144aac9fc41a124370a7a6 P 7920ad9361024fee82c0b421b7bf3e55 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:04.640035 31854 raft_consensus.cc:2454] T fb7b0b3fb7144aac9fc41a124370a7a6 P 7920ad9361024fee82c0b421b7bf3e55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db365a8b95e44ba09d09a51d99c951da in term 1.
I20260812 00:06:04.640240 32169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb7b0b3fb7144aac9fc41a124370a7a6" candidate_uuid: "db365a8b95e44ba09d09a51d99c951da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1fd8c470f9142e2b3da581852b72332"
I20260812 00:06:04.640314 32169 raft_consensus.cc:3037] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:04.640489 31933 leader_election.cc:302] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7920ad9361024fee82c0b421b7bf3e55, db365a8b95e44ba09d09a51d99c951da; no voters:
I20260812 00:06:04.640628 32254 raft_consensus.cc:2781] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:04.640782 32254 raft_consensus.cc:686] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [term 1 LEADER]: Becoming Leader. State: Replica: db365a8b95e44ba09d09a51d99c951da, State: Running, Role: LEADER
I20260812 00:06:04.640933 32254 consensus_queue.cc:237] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7920ad9361024fee82c0b421b7bf3e55" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45879 } } peers { permanent_uuid: "f1fd8c470f9142e2b3da581852b72332" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38561 } } peers { permanent_uuid: "db365a8b95e44ba09d09a51d99c951da" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 46681 } }
I20260812 00:06:04.641194 32169 raft_consensus.cc:2454] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db365a8b95e44ba09d09a51d99c951da in term 1.
I20260812 00:06:04.641760 31685 catalog_manager.cc:5495] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da reported cstate change: term changed from 0 to 1, leader changed from <none> to db365a8b95e44ba09d09a51d99c951da (127.19.59.66). New cstate: current_term: 1 leader_uuid: "db365a8b95e44ba09d09a51d99c951da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7920ad9361024fee82c0b421b7bf3e55" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1fd8c470f9142e2b3da581852b72332" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db365a8b95e44ba09d09a51d99c951da" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 46681 } health_report { overall_health: HEALTHY } } }
W20260812 00:06:04.648005 31910 tablet.cc:2369] T fb7b0b3fb7144aac9fc41a124370a7a6 P 7920ad9361024fee82c0b421b7bf3e55: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:06:04.655640 32242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.653849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40080 (local address 127.19.59.66:46681)
0812 00:06:04.653886 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:04.653887 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:04.653894 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:06:04.653952 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:04.653953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:04.653965 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:04.654014 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:06:04.654108 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.654496 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.655115 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:04.655269 (+ 154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:04.655312 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:04.655421 (+ 109us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:06:04.655496 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:06:04.655543 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:04.655572 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 00:06:04.655585 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:06:04.657124 31854 raft_consensus.cc:1261] T fb7b0b3fb7144aac9fc41a124370a7a6 P 7920ad9361024fee82c0b421b7bf3e55 [term 1 FOLLOWER]: Refusing update from remote peer db365a8b95e44ba09d09a51d99c951da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:06:04.657125 32169 raft_consensus.cc:1261] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332 [term 1 FOLLOWER]: Refusing update from remote peer db365a8b95e44ba09d09a51d99c951da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:06:04.657452 32257 consensus_queue.cc:1035] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1fd8c470f9142e2b3da581852b72332" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:06:04.657552 32254 consensus_queue.cc:1035] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [LEADER]: Connected to new peer: Peer: permanent_uuid: "7920ad9361024fee82c0b421b7bf3e55" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:06:04.659435 32260 mvcc.cc:205] Tried to move back new op lower bound from 7317476002433236992 to 7317476002369798144. Current Snapshot: MvccSnapshot[applied={T|T < 7317476002433236992}]
I20260812 00:06:04.661777 31686 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:06:04.661890 31686 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:06:04.662657 31686 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 629c3b2fe5614aacb10671824ef71631: Sending DeleteTablet for 3 replicas of tablet fb7b0b3fb7144aac9fc41a124370a7a6
I20260812 00:06:04.662966 31988 tablet_service.cc:1514] Processing DeleteTablet for tablet fb7b0b3fb7144aac9fc41a124370a7a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:06:04 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:50196
I20260812 00:06:04.663012 31832 tablet_service.cc:1514] Processing DeleteTablet for tablet fb7b0b3fb7144aac9fc41a124370a7a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:06:04 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:59448
I20260812 00:06:04.663168 32145 tablet_service.cc:1514] Processing DeleteTablet for tablet fb7b0b3fb7144aac9fc41a124370a7a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:06:04 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:53704
I20260812 00:06:04.663200 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 31762
I20260812 00:06:04.665789 32275 tablet_replica.cc:330] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332: stopping tablet replica
I20260812 00:06:04.665952 32275 raft_consensus.cc:2229] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:06:04.666059 32275 raft_consensus.cc:2258] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:06:04.666531 32275 ts_tablet_manager.cc:1905] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:06:04.668514 32275 ts_tablet_manager.cc:1918] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:06:04.668622 32275 log.cc:1196] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/fb7b0b3fb7144aac9fc41a124370a7a6
I20260812 00:06:04.668900 32275 ts_tablet_manager.cc:1939] T fb7b0b3fb7144aac9fc41a124370a7a6 P f1fd8c470f9142e2b3da581852b72332: Deleting consensus metadata
I20260812 00:06:04.669391 31668 catalog_manager.cc:4841] TS f1fd8c470f9142e2b3da581852b72332 (127.19.59.67:38561): tablet fb7b0b3fb7144aac9fc41a124370a7a6 (table test-table [id=4759ed1ec2ac4a8bb28f0172be7cadef]) successfully deleted
I20260812 00:06:04.669922 32273 tablet_replica.cc:330] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da: stopping tablet replica
I20260812 00:06:04.670027 32273 raft_consensus.cc:2229] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:06:04.670125 32273 raft_consensus.cc:2258] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:06:04.670526 32273 ts_tablet_manager.cc:1905] T fb7b0b3fb7144aac9fc41a124370a7a6 P db365a8b95e44ba09d09a51d99c951da: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 00:06:04.671907 31667 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:45879 (error 108)
I20260812 00:06:04.672184 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 31915
I20260812 00:06:04.672756 32241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.672323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:45879 (local address 127.0.0.1:57712)
0812 00:06:04.672684 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:04.672720 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:45879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342}
W20260812 00:06:04.673085 31667 catalog_manager.cc:4584] TS 7920ad9361024fee82c0b421b7bf3e55 (127.19.59.65:45879): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fb7b0b3fb7144aac9fc41a124370a7a6: Network error: Client connection negotiation failed: client connection to 127.19.59.65:45879: connect: Connection refused (error 111)
I20260812 00:06:04.678362 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 32074
I20260812 00:06:04.678387 32241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:04.678270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:46681 (local address 127.0.0.1:40090)
0812 00:06:04.678322 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:04.678353 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.66:46681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 00:06:04.683312 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 31650
2026-08-12T00:06:04Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2037 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:06:04 dist-test-slave-6nmv krb5kdc[32280](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:06:04 dist-test-slave-6nmv krb5kdc[32280](info): set up 2 sockets
Aug 12 00:06:04 dist-test-slave-6nmv krb5kdc[32280](info): commencing operation
krb5kdc: starting...
W20260812 00:06:05.754666 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:06:05 dist-test-slave-6nmv krb5kdc[32280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:05Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.19.59.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.19.59.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/rangeradmin_127.19.59.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/rangeradmin_127.19.59.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.19.59.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.19.59.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/rangerlookup_127.19.59.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/rangerlookup_127.19.59.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.59.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.19.59.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/HTTP_127.19.59.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/HTTP_127.19.59.84@KRBTEST.COM.keytab.
I20260812 00:06:05.916239 19693 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskBmexS9/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/postgres -l logfile start
2026-08-12 00:06:08.319 UTC [32317] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 00:06:08.319 UTC [32317] LOG: listening on IPv4 address "127.19.59.84", port 56777
2026-08-12 00:06:08.322 UTC [32317] LOG: listening on Unix socket "/tmp/.s.PGSQL.56777"
2026-08-12 00:06:08.343 UTC [32320] LOG: database system was shut down at 2026-08-12 00:06:06 UTC
2026-08-12 00:06:08.347 UTC [32317] LOG: database system is ready to accept connections
I20260812 00:06:09.333906 19693 mini_postgres.cc:96] Postgres bound to 56777
2026-08-12 00:06:09.340 UTC [32331] FATAL: database "slave" does not exist
127.19.59.84:56777 - accepting connections
I20260812 00:06:09.341742 19693 mini_ranger.cc:161] Starting Ranger...
I20260812 00:06:09.357066 19693 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 00:06:09.803788 19693 mini_ranger.cc:87] Created ranger Postgres database
I20260812 00:06:09.803874 19693 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-admin
2026-08-12 00:06:10,112 [I] DB FLAVOR :POSTGRES
2026-08-12 00:06:10,112 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:06:10,112 [I] Checking connection..
2026-08-12 00:06:10,112 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 00:06:10,353 [I] Checking connection passed.
2026-08-12 00:06:10,353 [I] --------- Verifying version history table ---------
2026-08-12 00:06:10,353 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:06:10,600 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:06:10,601 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:06:10,854 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:06:10,854 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 00:06:10,854 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 00:06:11.095 UTC [32414] WARNING: there is no transaction in progress
2026-08-12 00:06:11,103 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 00:06:11,104 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:06:11,336 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 00:06:11,337 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:06:11,337 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 00:06:11,568 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 00:06:11,825 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-6nmv.c.gcp-upstream.internal','N') ;"
2026-08-12 00:06:12,051 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:06:12,304 [I] Table x_portal_user does not exist in database ranger
2026-08-12 00:06:12,304 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:06:12,568 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 00:06:12,568 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:06:12,811 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:06:13,059 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 00:06:13,059 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 00:06:13.969 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:13.983 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:13.998 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:14.012 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:14.027 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:14.043 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:14.091 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:14.098 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:14.111 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:14.120 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:14.129 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:14.142 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:14.151 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:14.157 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:14.163 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:14.169 UTC [32540] WARNING: there is no transaction in progress
2026-08-12 00:06:14,774 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 00:06:14,774 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 00:06:14,993 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 00:06:14,993 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:06:15,238 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 00:06:15,238 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:06:15,479 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 00:06:15,479 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:06:15,710 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:06:15,972 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-6nmv.c.gcp-upstream.internal';"
2026-08-12 00:06:16,211 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 00:06:16,211 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 00:06:16,436 [I] DB_PATCHES have already been applied
I20260812 00:06:16.441956 19693 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-admin:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskBmexS9/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 00:06:16.442045 19693 mini_ranger.cc:193] Using host: 127.19.59.84
I20260812 00:06:16.445364 19693 mini_ranger.cc:227] Ranger admin URL: http://127.19.59.84:40053
Aug 12, 2026 12:06:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:06:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:06:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 12:06:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 12:06:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 12:06:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 12:06:17 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 00:06:17.615000 19693 mini_ranger.cc:160] Time spent starting Ranger: real 8.273s user 0.004s sys 0.006s
Aug 12, 2026 12:06:36 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 12:06:36 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 12, 2026 12:06:36 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 12:06:37 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 12:06:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 12:06:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 12:06:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 12:06:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 12:06:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 12:06:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 12:06:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 12:06:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 12:06:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 12:06:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 12:06:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 12:06:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 12:06:37 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 12:06:37 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 00:06:38.546314 19693 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.19.59.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.19.59.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/rangerkms_127.19.59.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/rangerkms_127.19.59.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.59.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.19.59.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.59.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/HTTP_127.19.59.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.59.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/HTTP_127.19.59.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 00:06:38 dist-test-slave-6nmv krb5kdc[32280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493198, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 00:06:38.649590 19693 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 00:06:38.659803 19693 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 00:06:39.440788 19693 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 00:06:39.440901 19693 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-kms
I20260812 00:06:39.440936 19693 mini_ranger_kms.cc:227] Using postgres at 127.19.59.84:56777
2026-08-12 00:06:39,909 [I] DB FLAVOR :POSTGRES
2026-08-12 00:06:39,909 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:06:39,910 [I] Checking connection
2026-08-12 00:06:39,910 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 00:06:40,149 [I] connection success
2026-08-12 00:06:40,149 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 00:06:40,149 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 00:06:40,149 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 00:06:40,406 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 00:06:40,406 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:06:40,407 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 00:06:40,407 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:56777/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 00:06:40,684 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 00:06:41.119931 19693 mini_ranger_kms.cc:310] Created kms service
I20260812 00:06:41.307082 19693 mini_ranger_kms.cc:326] Created kudu user
I20260812 00:06:41.347021 19693 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 00:06:41 dist-test-slave-6nmv krb5kdc[32280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493198, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:06:41.724928 19693 mini_ranger_kms.cc:384] Added ranger policy
I20260812 00:06:41.725055 19693 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-kms:/tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 00:06:41.725075 19693 mini_ranger_kms.cc:240] Using host: 127.19.59.84
I20260812 00:06:41.729741 19693 mini_ranger_kms.cc:276] Ranger KMS PID: 32748
I20260812 00:06:41.729898 19693 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.19.59.84:60179
Aug 12, 2026 12:06:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:06:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:06:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 12:06:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 12:06:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 12:06:43 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260812 00:06:44.112082 19693 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.462s user 0.007s sys 0.224s
I20260812 00:06:44.112201 19693 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 00:06:44.112295 19693 mini_ranger_kms.cc:401] 127.19.59.84:60179/kms/v1/keys
Aug 12 00:06:44 dist-test-slave-6nmv krb5kdc[32280](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786493204, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.59.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 12 00:06:44 dist-test-slave-6nmv krb5kdc[32280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493204, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.59.84@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
Aug 12 00:06:44 dist-test-slave-6nmv krb5kdc[32280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493204, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.59.84@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
Aug 12 00:06:47 dist-test-slave-6nmv krb5kdc[32280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493207, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:06:47.047094 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:34757
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:34757
--ranger_config_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.59.84:60179/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:47.128159 339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:47.128334 339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:47.128353 339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:47.129298 339 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:47.129328 339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:47.129340 339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:47.129351 339 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:47.129362 339 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:47.130887 339 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/wal
--ranger_kms_url=127.19.59.84:60179/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:34757
--ranger_config_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:34757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:47.131071 339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:47.131232 339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:47.136086 345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:47.136094 346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:47.136106 350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:47.136406 339 server_base.cc:1034] running on GCE node
I20260812 00:06:47.136605 339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:47.136869 339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:47.138005 339 hybrid_clock.cc:648] HybridClock initialized: now 1786493207137992 us; error 28 us; skew 500 ppm
Aug 12 00:06:47 dist-test-slave-6nmv krb5kdc[32280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493207, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:47.140429 339 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:06:47.140805 339 webserver.cc:460] Webserver started at http://127.19.59.126:42787/ using document root <none> and password file <none>
I20260812 00:06:47.141005 339 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:47.141043 339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:47.141149 339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:06:47 dist-test-slave-6nmv krb5kdc[32280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493207, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:06:47.194707 339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "92f0db764f2a46ba9e20c181b37c1190"
format_stamp: "Formatted at 2026-08-12 00:06:47 on dist-test-slave-6nmv"
server_key: "9690b8121aac22214dced66c0935ad30"
server_key_iv: "b3ffb05a23d91c52c48e839a6d8592bf"
server_key_version: "kuduclusterkey@0"
I20260812 00:06:47.195091 339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "92f0db764f2a46ba9e20c181b37c1190"
format_stamp: "Formatted at 2026-08-12 00:06:47 on dist-test-slave-6nmv"
server_key: "9690b8121aac22214dced66c0935ad30"
server_key_iv: "b3ffb05a23d91c52c48e839a6d8592bf"
server_key_version: "kuduclusterkey@0"
I20260812 00:06:47.196684 339 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:06:47.207809 357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:47.207989 339 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:06:47.208078 339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "92f0db764f2a46ba9e20c181b37c1190"
format_stamp: "Formatted at 2026-08-12 00:06:47 on dist-test-slave-6nmv"
server_key: "9690b8121aac22214dced66c0935ad30"
server_key_iv: "b3ffb05a23d91c52c48e839a6d8592bf"
server_key_version: "kuduclusterkey@0"
I20260812 00:06:47.208169 339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:47.223397 339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:47.225550 339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:47.225713 339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:47.229988 339 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:34757
I20260812 00:06:47.230034 421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:34757 every 8 connection(s)
I20260812 00:06:47.230386 339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:47.231035 422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:47.233026 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 339
I20260812 00:06:47.233106 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:06:47.233315 19693 external_mini_cluster.cc:1428] Setting key bcba92383086080b67e4fc46231f871a
I20260812 00:06:47.233618 422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190: Bootstrap starting.
I20260812 00:06:47.234301 422 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:47.234624 422 log.cc:824] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:47.235451 422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190: No bootstrap required, opened a new log
I20260812 00:06:47.237680 422 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f0db764f2a46ba9e20c181b37c1190" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34757 } }
I20260812 00:06:47.237857 422 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:47.237907 422 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92f0db764f2a46ba9e20c181b37c1190, State: Initialized, Role: FOLLOWER
I20260812 00:06:47.238037 422 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f0db764f2a46ba9e20c181b37c1190" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34757 } }
I20260812 00:06:47.238127 422 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:06:47.238158 422 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:06:47.238237 422 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:47.238929 422 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f0db764f2a46ba9e20c181b37c1190" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34757 } }
I20260812 00:06:47.239042 422 leader_election.cc:302] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92f0db764f2a46ba9e20c181b37c1190; no voters:
I20260812 00:06:47.239199 422 leader_election.cc:288] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:06:47.239235 427 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:47.239398 427 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [term 1 LEADER]: Becoming Leader. State: Replica: 92f0db764f2a46ba9e20c181b37c1190, State: Running, Role: LEADER
I20260812 00:06:47.239501 422 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:47.239529 427 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f0db764f2a46ba9e20c181b37c1190" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34757 } }
I20260812 00:06:47.239856 427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92f0db764f2a46ba9e20c181b37c1190. Latest consensus state: current_term: 1 leader_uuid: "92f0db764f2a46ba9e20c181b37c1190" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f0db764f2a46ba9e20c181b37c1190" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34757 } } }
I20260812 00:06:47.239866 429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "92f0db764f2a46ba9e20c181b37c1190" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f0db764f2a46ba9e20c181b37c1190" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34757 } } }
I20260812 00:06:47.240063 429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:47.240288 427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190 [sys.catalog]: This master's current role is: LEADER
Aug 12 00:06:47 dist-test-slave-6nmv krb5kdc[32280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493207, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:06:47.240669 435 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:47.241178 435 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:47.241734 422 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 00:06:47.246727 435 catalog_manager.cc:1347] Generated new cluster ID: fa44500c8f024bfeb383a5b7a94eec26
I20260812 00:06:47.246785 435 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:06:47.247979 425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:47.233860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51382 (local address 127.19.59.126:34757)
0812 00:06:47.234065 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:47.234074 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:47.234106 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:06:47.234602 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:47.234610 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:47.234658 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:47.234806 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:47.235594 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:47.236469 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:47.237545 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:47.238053 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:47.238184 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:47.241258 (+ 3074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:47.241262 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:47.241262 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:47.241275 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:47.245775 (+ 4500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:47.246263 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:47.246266 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:47.246266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:47.246376 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:47.246605 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:47.246605 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:47.246606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:47.246939 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:47.247464 (+ 525us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:47.247550 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 00:06:47.247700 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":93,"threads_started":1}
I20260812 00:06:47.275460 435 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:47.276254 435 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:47.279932 435 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190: Generated new TSK 0
I20260812 00:06:47.280138 435 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:06:47.934229 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.59.84:60179/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:34757
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:48.056069 474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:48.056360 474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:48.056404 474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:48.058187 474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:48.058247 474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:48.058290 474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:06:48.060464 474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.19.59.84:60179/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:34757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:48.060699 474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:48.060969 474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:48.066622 483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:48.066891 474 server_base.cc:1034] running on GCE node
W20260812 00:06:48.067011 480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:48.067216 485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:48.067456 474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:48.067785 474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:48.069020 474 hybrid_clock.cc:648] HybridClock initialized: now 1786493208068985 us; error 48 us; skew 500 ppm
Aug 12 00:06:48 dist-test-slave-6nmv krb5kdc[32280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493208, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:48.072309 474 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:06:48.072757 474 webserver.cc:460] Webserver started at http://127.19.59.65:40231/ using document root <none> and password file <none>
I20260812 00:06:48.073051 474 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:48.073166 474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:48.073328 474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:06:48 dist-test-slave-6nmv krb5kdc[32280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493208, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:06:48.089120 474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "a510db313890475d856f0ad20d3c97ff"
format_stamp: "Formatted at 2026-08-12 00:06:48 on dist-test-slave-6nmv"
server_key: "90557a6e7a51c29b2c7c3ec4cf6c7e4a"
server_key_iv: "5d2c4ff5ee3c33cfae7131d7b5832cf2"
server_key_version: "kuduclusterkey@0"
I20260812 00:06:48.089596 474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "a510db313890475d856f0ad20d3c97ff"
format_stamp: "Formatted at 2026-08-12 00:06:48 on dist-test-slave-6nmv"
server_key: "90557a6e7a51c29b2c7c3ec4cf6c7e4a"
server_key_iv: "5d2c4ff5ee3c33cfae7131d7b5832cf2"
server_key_version: "kuduclusterkey@0"
I20260812 00:06:48.091627 474 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260812 00:06:48.105612 494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:48.105847 474 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:06:48.106063 474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "a510db313890475d856f0ad20d3c97ff"
format_stamp: "Formatted at 2026-08-12 00:06:48 on dist-test-slave-6nmv"
server_key: "90557a6e7a51c29b2c7c3ec4cf6c7e4a"
server_key_iv: "5d2c4ff5ee3c33cfae7131d7b5832cf2"
server_key_version: "kuduclusterkey@0"
I20260812 00:06:48.106244 474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:48.118306 474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:48.120975 474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:48.121201 474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:48.121520 474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:06:48.121958 474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:06:48.122054 474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:48.122174 474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:06:48.122254 474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:48.129673 474 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:34927
I20260812 00:06:48.129765 625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:34927 every 8 connection(s)
I20260812 00:06:48.130097 474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:06:48.132055 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 474
I20260812 00:06:48.132187 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:06:48.132380 19693 external_mini_cluster.cc:1428] Setting key ba7f5044507be8b1065614eee5465460
Aug 12 00:06:48 dist-test-slave-6nmv krb5kdc[32280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493208, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:06:48.141692 629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.130820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:34757 (local address 127.19.59.65:37641)
0812 00:06:48.131015 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:48.131064 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:48.131533 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:48.131942 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:48.131947 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:48.132179 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:48.132467 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.132475 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.133456 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.133457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.134748 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.134751 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.135264 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.135265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.135422 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.135982 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:48.135993 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:48.137739 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:48.139979 (+ 2240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:48.140009 (+ 30us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:48.140011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:48.140319 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:48.140574 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:48.140574 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:48.140575 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:48.140711 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:48.141027 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:48.141033 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:48.141196 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 00:06:48.141301 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 00:06:48.141458 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
I20260812 00:06:48.142400 630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.130870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:37641 (local address 127.19.59.126:34757)
0812 00:06:48.131714 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:48.131715 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:48.131722 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:06:48.131744 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:48.131745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:48.131755 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:48.131813 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:48.132565 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.133334 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.134856 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.135170 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.135649 (+ 479us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.137889 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:48.137891 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:48.137891 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:48.137900 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:48.139876 (+ 1976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:48.140430 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:48.140431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:48.140431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:48.140500 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:48.140791 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:48.140792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:48.140792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:48.140940 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:48.142156 (+ 1216us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:48.142202 (+ 46us) server_negotiation.cc:299] Negotiation successful
0812 00:06:48.142288 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":815,"thread_start_us":95,"threads_started":1}
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
I20260812 00:06:48.142947 626 heartbeater.cc:347] Connected to a master server at 127.19.59.126:34757
I20260812 00:06:48.143033 626 heartbeater.cc:464] Registering TS with master...
I20260812 00:06:48.143198 626 heartbeater.cc:511] Master 127.19.59.126:34757 requested a full tablet report, sending...
I20260812 00:06:48.143743 378 ts_manager.cc:194] Registered new tserver with Master: a510db313890475d856f0ad20d3c97ff (127.19.59.65:34927)
I20260812 00:06:48.144304 378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:37641
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:06:48.165091 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.59.84:60179/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:34757
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:48.271773 633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:48.272013 633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:48.272055 633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:48.273293 633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:48.273357 633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:48.273401 633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:06:48.275043 633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.19.59.84:60179/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:34757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:48.275305 633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:48.275548 633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:48.280447 643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:48.280449 645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:48.280987 641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:48.281457 633 server_base.cc:1034] running on GCE node
I20260812 00:06:48.281643 633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:48.281908 633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:48.289342 633 hybrid_clock.cc:648] HybridClock initialized: now 1786493208289325 us; error 30 us; skew 500 ppm
Aug 12 00:06:48 dist-test-slave-6nmv krb5kdc[32280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493208, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:48.292111 633 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:06:48.292622 633 webserver.cc:460] Webserver started at http://127.19.59.66:40189/ using document root <none> and password file <none>
I20260812 00:06:48.292929 633 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:48.293051 633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:48.293246 633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:06:48 dist-test-slave-6nmv krb5kdc[32280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493208, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:06:48.307154 633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "b0bd3acd78db4d16904ff9d4907c64d8"
format_stamp: "Formatted at 2026-08-12 00:06:48 on dist-test-slave-6nmv"
server_key: "3b5ff02d629d04e88a32ba8da108bd39"
server_key_iv: "d98e6d82ba643ac740fdb5f049a9e713"
server_key_version: "kuduclusterkey@0"
I20260812 00:06:48.307650 633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "b0bd3acd78db4d16904ff9d4907c64d8"
format_stamp: "Formatted at 2026-08-12 00:06:48 on dist-test-slave-6nmv"
server_key: "3b5ff02d629d04e88a32ba8da108bd39"
server_key_iv: "d98e6d82ba643ac740fdb5f049a9e713"
server_key_version: "kuduclusterkey@0"
Aug 12 00:06:48 dist-test-slave-6nmv krb5kdc[32280](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786493208, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:48.309880 633 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 00:06:48.321650 653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:48.321826 633 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:06:48.321918 633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "b0bd3acd78db4d16904ff9d4907c64d8"
format_stamp: "Formatted at 2026-08-12 00:06:48 on dist-test-slave-6nmv"
server_key: "3b5ff02d629d04e88a32ba8da108bd39"
server_key_iv: "d98e6d82ba643ac740fdb5f049a9e713"
server_key_version: "kuduclusterkey@0"
I20260812 00:06:48.321987 633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:48.333192 633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:48.341431 633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:48.341609 633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:48.341854 633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:06:48.342247 633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:06:48.342334 633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:48.342402 633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:06:48.342461 633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:48.349216 633 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:38241
I20260812 00:06:48.351900 633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:06:48.353487 780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:38241 every 8 connection(s)
I20260812 00:06:48.356473 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 633
I20260812 00:06:48.356575 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:06:48.356760 19693 external_mini_cluster.cc:1428] Setting key 1175da0748b72ec2a01890a78b229713
Aug 12 00:06:48 dist-test-slave-6nmv krb5kdc[32280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493208, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:06:48.364566 630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.354745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:54411 (local address 127.19.59.126:34757)
0812 00:06:48.354793 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:48.354795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:48.355016 (+ 221us) server_negotiation.cc:407] Connection header received
0812 00:06:48.355494 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:48.355495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:48.355511 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:48.355572 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:48.356308 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.357055 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.358887 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.359195 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.359238 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.361608 (+ 2370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:48.361609 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:48.361610 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:48.361617 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:48.363114 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:48.363529 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:48.363530 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:48.363531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:48.363587 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:48.363865 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:48.363866 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:48.363867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:48.364043 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:48.364120 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:48.364384 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 00:06:48.364469 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:06:48.364734 785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.354689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:34757 (local address 127.19.59.66:54411)
0812 00:06:48.354855 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:48.354894 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:48.355379 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:48.355685 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:48.355689 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:48.355903 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:48.356193 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.356199 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.357518 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.357519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.358789 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.358792 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.359331 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.359332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.359487 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.360020 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:48.360028 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:48.361509 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:48.363229 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:48.363235 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:48.363237 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:48.363439 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:48.363680 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:48.363681 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:48.363681 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:48.363790 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:48.364124 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:48.364130 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:48.364254 (+ 124us) client_negotiation.cc:769] Sending connection context
0812 00:06:48.364365 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 00:06:48.364497 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":92,"threads_started":1}
I20260812 00:06:48.365275 783 heartbeater.cc:347] Connected to a master server at 127.19.59.126:34757
I20260812 00:06:48.365358 783 heartbeater.cc:464] Registering TS with master...
I20260812 00:06:48.365521 783 heartbeater.cc:511] Master 127.19.59.126:34757 requested a full tablet report, sending...
I20260812 00:06:48.365851 378 ts_manager.cc:194] Registered new tserver with Master: b0bd3acd78db4d16904ff9d4907c64d8 (127.19.59.66:38241)
I20260812 00:06:48.366204 378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:54411
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:06:48.389454 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.59.84:60179/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:34757
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:48.490880 790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:48.491128 790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:48.491169 790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:48.492398 790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:48.492488 790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:48.492537 790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:06:48.494035 790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.19.59.84:60179/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:34757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:06:48.494261 790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:48.494463 790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:48.499418 797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:48.499604 802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:48.499418 798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:48.500554 790 server_base.cc:1034] running on GCE node
I20260812 00:06:48.500785 790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:48.501065 790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:48.502214 790 hybrid_clock.cc:648] HybridClock initialized: now 1786493208502197 us; error 34 us; skew 500 ppm
Aug 12 00:06:48 dist-test-slave-6nmv krb5kdc[32280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493208, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:48.508121 790 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:06:48.508565 790 webserver.cc:460] Webserver started at http://127.19.59.67:34501/ using document root <none> and password file <none>
I20260812 00:06:48.508790 790 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:48.508860 790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:48.508985 790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:06:48 dist-test-slave-6nmv krb5kdc[32280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493208, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:06:48.522236 790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "3df52d3df51745248506a34b98d9889c"
format_stamp: "Formatted at 2026-08-12 00:06:48 on dist-test-slave-6nmv"
server_key: "feb29d5525211e6b100ba6997cf5c0f3"
server_key_iv: "32ad9a4740bb2e8148b53ffe52015d60"
server_key_version: "kuduclusterkey@0"
I20260812 00:06:48.522742 790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "3df52d3df51745248506a34b98d9889c"
format_stamp: "Formatted at 2026-08-12 00:06:48 on dist-test-slave-6nmv"
server_key: "feb29d5525211e6b100ba6997cf5c0f3"
server_key_iv: "32ad9a4740bb2e8148b53ffe52015d60"
server_key_version: "kuduclusterkey@0"
I20260812 00:06:48.524782 790 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 00:06:48.541105 809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:48.541347 790 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.000s
I20260812 00:06:48.541497 790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "3df52d3df51745248506a34b98d9889c"
format_stamp: "Formatted at 2026-08-12 00:06:48 on dist-test-slave-6nmv"
server_key: "feb29d5525211e6b100ba6997cf5c0f3"
server_key_iv: "32ad9a4740bb2e8148b53ffe52015d60"
server_key_version: "kuduclusterkey@0"
I20260812 00:06:48.541661 790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:48.587159 790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:48.589200 790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:48.589306 790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:48.589597 790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:06:48.589972 790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:06:48.590025 790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:48.590068 790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:06:48.590112 790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:48.600575 790 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:35631
I20260812 00:06:48.600792 943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:35631 every 8 connection(s)
I20260812 00:06:48.601069 790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:06:48 dist-test-slave-6nmv krb5kdc[32280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493208, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:06:48.611158 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 790
I20260812 00:06:48.611330 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:06:48.611590 19693 external_mini_cluster.cc:1428] Setting key d498b77f0f0b34413a218cb356dfead9
I20260812 00:06:48.618659 630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.601924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:48367 (local address 127.19.59.126:34757)
0812 00:06:48.601969 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:48.601972 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:48.602221 (+ 249us) server_negotiation.cc:407] Connection header received
0812 00:06:48.603017 (+ 796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:48.603018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:48.603056 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:48.603107 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:48.604376 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.605222 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.606377 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.606628 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.606695 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.609570 (+ 2875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:48.609572 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:48.609572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:48.609580 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:48.612665 (+ 3085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:48.613212 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:48.613212 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:48.613213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:48.613268 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:48.613639 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:48.613640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:48.613640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:48.613771 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:48.613937 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:48.618474 (+ 4537us) server_negotiation.cc:299] Negotiation successful
0812 00:06:48.618567 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:06:48.619436 947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.601924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:34757 (local address 127.19.59.67:48367)
0812 00:06:48.602095 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:48.602135 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:48.602900 (+ 765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:48.603174 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:48.603178 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:48.603655 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:48.604099 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.604106 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.605317 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.605318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.606261 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.606264 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.606748 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.606750 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.606971 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.607582 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:48.607594 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:48.609444 (+ 1850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:48.612756 (+ 3312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:48.612763 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:48.612765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:48.613122 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:48.613340 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:48.613341 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:48.613341 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:48.613481 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:48.618114 (+ 4633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:48.618120 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:48.618283 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 00:06:48.619027 (+ 744us) client_negotiation.cc:240] Negotiation successful
0812 00:06:48.619200 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":84,"threads_started":1}
I20260812 00:06:48.620738 944 heartbeater.cc:347] Connected to a master server at 127.19.59.126:34757
I20260812 00:06:48.620848 944 heartbeater.cc:464] Registering TS with master...
I20260812 00:06:48.621089 944 heartbeater.cc:511] Master 127.19.59.126:34757 requested a full tablet report, sending...
I20260812 00:06:48.621587 378 ts_manager.cc:194] Registered new tserver with Master: 3df52d3df51745248506a34b98d9889c (127.19.59.67:35631)
I20260812 00:06:48.622071 378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:48367
I20260812 00:06:48.623202 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:06:48.632534 630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.624823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51390 (local address 127.19.59.126:34757)
0812 00:06:48.624856 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:48.624857 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:48.625130 (+ 273us) server_negotiation.cc:407] Connection header received
0812 00:06:48.625226 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:48.625227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:48.625236 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:48.625262 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:48.626052 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.626727 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.627746 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.628002 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.628045 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.629485 (+ 1440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:48.629487 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:48.629487 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:48.629494 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:48.631218 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:48.631686 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:48.631687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:48.631688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:48.631746 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:48.631956 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:48.631957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:48.631957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:48.632077 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:48.632151 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:48.632358 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 00:06:48.632433 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 00:06:48.634684 378 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51390:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:06:48.636994 378 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:06:48.649684 959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.641294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:35631 (local address 127.0.0.1:51496)
0812 00:06:48.641468 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:48.641510 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:48.641580 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:48.642571 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:48.642574 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:48.642577 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:06:48.642639 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.642640 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.647071 (+ 4431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.647072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.648403 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.648406 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.649361 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.649362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.649444 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.649459 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 00:06:48.649546 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 00:06:48.649610 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":85,"threads_started":1}
I20260812 00:06:48.649749 962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.641972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51496 (local address 127.19.59.67:35631)
0812 00:06:48.642366 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:48.642371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:48.642382 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:06:48.642426 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:48.642428 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:48.642443 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:48.642717 (+ 274us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:06:48.645856 (+ 3139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.646959 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.648540 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.649260 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.649358 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.649440 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:48.649595 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 00:06:48.649637 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":166,"threads_started":1}
I20260812 00:06:48.650852 869 tablet_service.cc:1467] Processing CreateTablet for tablet 043bf2088088488e810153e708308db4 (DEFAULT_TABLE table=test-table [id=075f9e8382c2403a8a55c7749629ba1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:06:48.651221 869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 043bf2088088488e810153e708308db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:48.655126 966 tablet_bootstrap.cc:492] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c: Bootstrap starting.
I20260812 00:06:48.657967 959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.642510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:38241 (local address 127.0.0.1:38162)
0812 00:06:48.649753 (+ 7243us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:48.649764 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:48.649802 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:48.654240 (+ 4438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:48.654241 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:48.654243 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:06:48.654289 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.654290 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.655701 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.655703 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.656763 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.656766 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.657746 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.657747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.657836 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.657840 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:06:48.657868 (+ 28us) client_negotiation.cc:240] Negotiation successful
0812 00:06:48.657903 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7234,"thread_start_us":188,"threads_started":1}
I20260812 00:06:48.658421 965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.642925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38162 (local address 127.19.59.66:38241)
0812 00:06:48.654084 (+ 11159us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:48.654088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:48.654097 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:06:48.654134 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:48.654136 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:48.654149 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:48.654361 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:06:48.654439 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.655606 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.656887 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.657648 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.658208 (+ 560us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.658289 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:48.658312 (+ 23us) server_negotiation.cc:299] Negotiation successful
0812 00:06:48.658348 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11122,"thread_start_us":174,"threads_started":1}
I20260812 00:06:48.658806 960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.641551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:34927 (local address 127.0.0.1:41212)
0812 00:06:48.641686 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:48.641694 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:48.641726 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:48.654864 (+ 13138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:48.654864 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:48.654866 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:06:48.654904 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.654905 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.656160 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.656161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.657294 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.657296 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.658601 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.658602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.658662 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.658667 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:06:48.658706 (+ 39us) client_negotiation.cc:240] Negotiation successful
0812 00:06:48.658741 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
I20260812 00:06:48.659271 705 tablet_service.cc:1467] Processing CreateTablet for tablet 043bf2088088488e810153e708308db4 (DEFAULT_TABLE table=test-table [id=075f9e8382c2403a8a55c7749629ba1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:06:48.659633 705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 043bf2088088488e810153e708308db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:48.663147 967 tablet_bootstrap.cc:492] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8: Bootstrap starting.
I20260812 00:06:48.663545 963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.642227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41212 (local address 127.19.59.65:34927)
0812 00:06:48.653912 (+ 11685us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:48.653916 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:48.653942 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:06:48.653994 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:48.654011 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:48.654040 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:48.654127 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:06:48.655010 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.656087 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.657395 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.658506 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.663355 (+ 4849us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.663423 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:48.663446 (+ 23us) server_negotiation.cc:299] Negotiation successful
0812 00:06:48.663482 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11649,"thread_start_us":60,"threads_started":1}
I20260812 00:06:48.664057 547 tablet_service.cc:1467] Processing CreateTablet for tablet 043bf2088088488e810153e708308db4 (DEFAULT_TABLE table=test-table [id=075f9e8382c2403a8a55c7749629ba1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:06:48.664350 547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 043bf2088088488e810153e708308db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:48.664987 967 tablet_bootstrap.cc:654] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:48.665359 967 log.cc:824] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:48.666006 966 tablet_bootstrap.cc:654] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:48.666395 966 log.cc:824] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:48.667182 967 tablet_bootstrap.cc:492] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8: No bootstrap required, opened a new log
I20260812 00:06:48.667245 967 ts_tablet_manager.cc:1397] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 00:06:48.668296 970 tablet_bootstrap.cc:492] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff: Bootstrap starting.
I20260812 00:06:48.668918 970 tablet_bootstrap.cc:654] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:48.668984 967 raft_consensus.cc:348] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3df52d3df51745248506a34b98d9889c" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35631 } } peers { permanent_uuid: "a510db313890475d856f0ad20d3c97ff" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 34927 } } peers { permanent_uuid: "b0bd3acd78db4d16904ff9d4907c64d8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38241 } }
I20260812 00:06:48.669121 967 raft_consensus.cc:374] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:48.669152 967 raft_consensus.cc:729] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0bd3acd78db4d16904ff9d4907c64d8, State: Initialized, Role: FOLLOWER
I20260812 00:06:48.669185 970 log.cc:824] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:48.669250 967 consensus_queue.cc:260] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3df52d3df51745248506a34b98d9889c" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35631 } } peers { permanent_uuid: "a510db313890475d856f0ad20d3c97ff" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 34927 } } peers { permanent_uuid: "b0bd3acd78db4d16904ff9d4907c64d8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38241 } }
I20260812 00:06:48.669479 967 ts_tablet_manager.cc:1428] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:06:48.669682 966 tablet_bootstrap.cc:492] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c: No bootstrap required, opened a new log
I20260812 00:06:48.669746 966 ts_tablet_manager.cc:1397] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260812 00:06:48.669929 783 heartbeater.cc:503] Master 127.19.59.126:34757 was elected leader, sending a full tablet report...
I20260812 00:06:48.671797 966 raft_consensus.cc:348] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3df52d3df51745248506a34b98d9889c" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35631 } } peers { permanent_uuid: "a510db313890475d856f0ad20d3c97ff" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 34927 } } peers { permanent_uuid: "b0bd3acd78db4d16904ff9d4907c64d8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38241 } }
I20260812 00:06:48.671960 966 raft_consensus.cc:374] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:48.671999 966 raft_consensus.cc:729] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3df52d3df51745248506a34b98d9889c, State: Initialized, Role: FOLLOWER
I20260812 00:06:48.672106 966 consensus_queue.cc:260] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3df52d3df51745248506a34b98d9889c" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35631 } } peers { permanent_uuid: "a510db313890475d856f0ad20d3c97ff" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 34927 } } peers { permanent_uuid: "b0bd3acd78db4d16904ff9d4907c64d8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38241 } }
I20260812 00:06:48.672362 966 ts_tablet_manager.cc:1428] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:06:48.672616 944 heartbeater.cc:503] Master 127.19.59.126:34757 was elected leader, sending a full tablet report...
I20260812 00:06:48.673724 970 tablet_bootstrap.cc:492] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff: No bootstrap required, opened a new log
I20260812 00:06:48.673875 970 ts_tablet_manager.cc:1397] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260812 00:06:48.676312 970 raft_consensus.cc:348] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3df52d3df51745248506a34b98d9889c" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35631 } } peers { permanent_uuid: "a510db313890475d856f0ad20d3c97ff" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 34927 } } peers { permanent_uuid: "b0bd3acd78db4d16904ff9d4907c64d8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38241 } }
I20260812 00:06:48.676457 970 raft_consensus.cc:374] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:48.676505 970 raft_consensus.cc:729] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a510db313890475d856f0ad20d3c97ff, State: Initialized, Role: FOLLOWER
I20260812 00:06:48.676605 970 consensus_queue.cc:260] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3df52d3df51745248506a34b98d9889c" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35631 } } peers { permanent_uuid: "a510db313890475d856f0ad20d3c97ff" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 34927 } } peers { permanent_uuid: "b0bd3acd78db4d16904ff9d4907c64d8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38241 } }
I20260812 00:06:48.676832 970 ts_tablet_manager.cc:1428] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:06:48.676867 626 heartbeater.cc:503] Master 127.19.59.126:34757 was elected leader, sending a full tablet report...
Aug 12 00:06:48 dist-test-slave-6nmv krb5kdc[32280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493208, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
W20260812 00:06:48.851871 945 tablet.cc:2369] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:06:48.854563 784 tablet.cc:2369] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:06:48.881040 627 tablet.cc:2369] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:06:48.927580 974 raft_consensus.cc:482] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:06:48.927760 974 raft_consensus.cc:504] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3df52d3df51745248506a34b98d9889c" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35631 } } peers { permanent_uuid: "a510db313890475d856f0ad20d3c97ff" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 34927 } } peers { permanent_uuid: "b0bd3acd78db4d16904ff9d4907c64d8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38241 } }
I20260812 00:06:48.928197 974 leader_election.cc:288] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3df52d3df51745248506a34b98d9889c (127.19.59.67:35631), b0bd3acd78db4d16904ff9d4907c64d8 (127.19.59.66:38241)
I20260812 00:06:48.932626 965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.928610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:45123 (local address 127.19.59.66:38241)
0812 00:06:48.928657 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:48.928659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:48.928984 (+ 325us) server_negotiation.cc:407] Connection header received
0812 00:06:48.929082 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:48.929083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:48.929092 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:48.929119 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:06:48.929326 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.930023 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.931770 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.932259 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.932305 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.932314 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:48.932520 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 00:06:48.932558 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:06:48.932741 962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.928618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:53285 (local address 127.19.59.67:35631)
0812 00:06:48.928660 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:48.928662 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:48.928813 (+ 151us) server_negotiation.cc:407] Connection header received
0812 00:06:48.928935 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:48.928936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:48.928950 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:48.928980 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:06:48.929241 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.930004 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.931813 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.932347 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.932407 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.932416 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:48.932639 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 00:06:48.932676 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:06:48.933001 975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.928391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:35631 (local address 127.19.59.65:53285)
0812 00:06:48.928729 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:48.928740 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:48.928854 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:48.929054 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:48.929055 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:48.929057 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:06:48.929142 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.929144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.930349 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.930350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.931699 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.931702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.932476 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.932477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.932555 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.932558 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:06:48.932873 (+ 315us) client_negotiation.cc:240] Negotiation successful
0812 00:06:48.932916 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":129,"thread_start_us":106,"threads_started":1}
I20260812 00:06:48.933269 976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:48.928420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:38241 (local address 127.19.59.65:45123)
0812 00:06:48.928777 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:48.928787 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:48.929015 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:48.929178 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:48.929179 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:48.929180 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:06:48.929261 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.929263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.930139 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.930140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.931667 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:48.931670 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:48.932368 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:48.932368 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:48.932442 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:48.932445 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:06:48.933038 (+ 593us) client_negotiation.cc:240] Negotiation successful
0812 00:06:48.933190 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":61,"thread_start_us":88,"threads_started":1}
I20260812 00:06:48.933378 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "043bf2088088488e810153e708308db4" candidate_uuid: "a510db313890475d856f0ad20d3c97ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3df52d3df51745248506a34b98d9889c" is_pre_election: true
I20260812 00:06:48.933539 893 raft_consensus.cc:2454] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a510db313890475d856f0ad20d3c97ff in term 0.
I20260812 00:06:48.933583 723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "043bf2088088488e810153e708308db4" candidate_uuid: "a510db313890475d856f0ad20d3c97ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0bd3acd78db4d16904ff9d4907c64d8" is_pre_election: true
I20260812 00:06:48.933734 723 raft_consensus.cc:2454] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a510db313890475d856f0ad20d3c97ff in term 0.
I20260812 00:06:48.933759 497 leader_election.cc:302] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3df52d3df51745248506a34b98d9889c, a510db313890475d856f0ad20d3c97ff; no voters:
I20260812 00:06:48.933902 974 raft_consensus.cc:2781] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:06:48.933949 974 raft_consensus.cc:482] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:06:48.933977 974 raft_consensus.cc:3037] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:48.934885 974 raft_consensus.cc:504] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3df52d3df51745248506a34b98d9889c" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35631 } } peers { permanent_uuid: "a510db313890475d856f0ad20d3c97ff" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 34927 } } peers { permanent_uuid: "b0bd3acd78db4d16904ff9d4907c64d8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38241 } }
I20260812 00:06:48.935019 974 leader_election.cc:288] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [CANDIDATE]: Term 1 election: Requested vote from peers 3df52d3df51745248506a34b98d9889c (127.19.59.67:35631), b0bd3acd78db4d16904ff9d4907c64d8 (127.19.59.66:38241)
I20260812 00:06:48.935189 723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "043bf2088088488e810153e708308db4" candidate_uuid: "a510db313890475d856f0ad20d3c97ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0bd3acd78db4d16904ff9d4907c64d8"
I20260812 00:06:48.935263 723 raft_consensus.cc:3037] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:48.935484 893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "043bf2088088488e810153e708308db4" candidate_uuid: "a510db313890475d856f0ad20d3c97ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3df52d3df51745248506a34b98d9889c"
I20260812 00:06:48.935580 893 raft_consensus.cc:3037] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:48.936151 723 raft_consensus.cc:2454] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a510db313890475d856f0ad20d3c97ff in term 1.
I20260812 00:06:48.936323 498 leader_election.cc:302] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a510db313890475d856f0ad20d3c97ff, b0bd3acd78db4d16904ff9d4907c64d8; no voters:
I20260812 00:06:48.936496 893 raft_consensus.cc:2454] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a510db313890475d856f0ad20d3c97ff in term 1.
I20260812 00:06:48.936517 974 raft_consensus.cc:2781] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:48.936648 974 raft_consensus.cc:686] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [term 1 LEADER]: Becoming Leader. State: Replica: a510db313890475d856f0ad20d3c97ff, State: Running, Role: LEADER
I20260812 00:06:48.936733 974 consensus_queue.cc:237] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3df52d3df51745248506a34b98d9889c" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35631 } } peers { permanent_uuid: "a510db313890475d856f0ad20d3c97ff" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 34927 } } peers { permanent_uuid: "b0bd3acd78db4d16904ff9d4907c64d8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38241 } }
I20260812 00:06:48.937633 378 catalog_manager.cc:5495] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff reported cstate change: term changed from 0 to 1, leader changed from <none> to a510db313890475d856f0ad20d3c97ff (127.19.59.65). New cstate: current_term: 1 leader_uuid: "a510db313890475d856f0ad20d3c97ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3df52d3df51745248506a34b98d9889c" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a510db313890475d856f0ad20d3c97ff" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 34927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0bd3acd78db4d16904ff9d4907c64d8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38241 } health_report { overall_health: UNKNOWN } } }
Aug 12 00:06:48 dist-test-slave-6nmv krb5kdc[32280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493208, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:06:49.014256 963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:49.010522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41220 (local address 127.19.59.65:34927)
0812 00:06:49.010705 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:49.010708 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:49.010716 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:06:49.010761 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:49.010762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:49.010785 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:49.010856 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:06:49.011080 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:49.011870 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:49.013012 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:49.013369 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:49.013429 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:49.013634 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:06:49.013783 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:06:49.013862 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:49.014132 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 00:06:49.014154 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159}
I20260812 00:06:49.016248 723 raft_consensus.cc:1261] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8 [term 1 FOLLOWER]: Refusing update from remote peer a510db313890475d856f0ad20d3c97ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:06:49.016283 893 raft_consensus.cc:1261] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c [term 1 FOLLOWER]: Refusing update from remote peer a510db313890475d856f0ad20d3c97ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:06:49.016609 977 consensus_queue.cc:1035] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0bd3acd78db4d16904ff9d4907c64d8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 38241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:06:49.016724 974 consensus_queue.cc:1035] T 043bf2088088488e810153e708308db4 P a510db313890475d856f0ad20d3c97ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "3df52d3df51745248506a34b98d9889c" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:06:49.020177 981 mvcc.cc:205] Tried to move back new op lower bound from 7317476184127528960 to 7317476183805333504. Current Snapshot: MvccSnapshot[applied={T|T < 7317476184127528960 or (T in {7317476184127528960})}]
I20260812 00:06:49.022113 378 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51390:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:06:49.022209 378 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51390:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:06:49.022941 378 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 92f0db764f2a46ba9e20c181b37c1190: Sending DeleteTablet for 3 replicas of tablet 043bf2088088488e810153e708308db4
I20260812 00:06:49.023347 869 tablet_service.cc:1514] Processing DeleteTablet for tablet 043bf2088088488e810153e708308db4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:06:49 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:51496
I20260812 00:06:49.023559 547 tablet_service.cc:1514] Processing DeleteTablet for tablet 043bf2088088488e810153e708308db4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:06:49 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:41212
I20260812 00:06:49.023849 705 tablet_service.cc:1514] Processing DeleteTablet for tablet 043bf2088088488e810153e708308db4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:06:49 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:38162
I20260812 00:06:49.024439 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 474
I20260812 00:06:49.026023 989 tablet_replica.cc:330] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c: stopping tablet replica
I20260812 00:06:49.026121 989 raft_consensus.cc:2229] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:06:49.026180 989 raft_consensus.cc:2258] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:06:49.026621 991 tablet_replica.cc:330] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8: stopping tablet replica
I20260812 00:06:49.026760 991 raft_consensus.cc:2229] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:06:49.026821 991 pending_rounds.cc:62] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8: Trying to abort 2 pending ops.
I20260812 00:06:49.026847 991 pending_rounds.cc:68] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7317476184127528960 op_type: WRITE_OP write_request { tablet_id: "043bf2088088488e810153e708308db4" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\305\364\356\323\006\"8\n\ntest-admin\022*\n 075f9e8382c2403a8a55c7749629ba1e\020\001\030\001 \001(\001" signature: "<redacted>""w@\323\2221\224\253H}\331\203\260\235\221\2243\357\327x\346\035@TL\202\324\345\346Hm\001\265c\253\310\341N\272\036j \023\216\034\231#/~c\027\267\203\022\365\305q\307Y\023\207\201:X\202" signing_key_seq_num: 0 } } request_id { client_id: "99c17efb08bd45ddb4ab6a92de8d917a" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260812 00:06:49.027072 991 pending_rounds.cc:68] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317476183805333504 op_type: NO_OP noop_request { }
I20260812 00:06:49.027115 991 raft_consensus.cc:2866] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 00:06:49.027139 991 raft_consensus.cc:2258] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:06:49.027762 991 ts_tablet_manager.cc:1905] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:06:49.032881 991 ts_tablet_manager.cc:1918] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:06:49.033010 991 log.cc:1196] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/043bf2088088488e810153e708308db4
I20260812 00:06:49.033313 991 ts_tablet_manager.cc:1939] T 043bf2088088488e810153e708308db4 P b0bd3acd78db4d16904ff9d4907c64d8: Deleting consensus metadata
I20260812 00:06:49.033845 360 catalog_manager.cc:4841] TS b0bd3acd78db4d16904ff9d4907c64d8 (127.19.59.66:38241): tablet 043bf2088088488e810153e708308db4 (table test-table [id=075f9e8382c2403a8a55c7749629ba1e]) successfully deleted
I20260812 00:06:49.035498 989 ts_tablet_manager.cc:1905] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 00:06:49.036919 657 connection.cc:535] server connection from 127.19.59.65:45123 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:06:49.037352 989 ts_tablet_manager.cc:1918] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:06:49.037408 989 log.cc:1196] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/043bf2088088488e810153e708308db4
I20260812 00:06:49.038019 989 ts_tablet_manager.cc:1939] T 043bf2088088488e810153e708308db4 P 3df52d3df51745248506a34b98d9889c: Deleting consensus metadata
W20260812 00:06:49.038007 358 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:34927 (error 108)
I20260812 00:06:49.038419 359 catalog_manager.cc:4841] TS 3df52d3df51745248506a34b98d9889c (127.19.59.67:35631): tablet 043bf2088088488e810153e708308db4 (table test-table [id=075f9e8382c2403a8a55c7749629ba1e]) successfully deleted
I20260812 00:06:49.038867 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 633
I20260812 00:06:49.040305 960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:49.039081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:34927 (local address 127.0.0.1:41234)
0812 00:06:49.040230 (+ 1149us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:49.040272 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:34927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1128}
W20260812 00:06:49.047186 358 catalog_manager.cc:4584] TS a510db313890475d856f0ad20d3c97ff (127.19.59.65:34927): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 043bf2088088488e810153e708308db4: Network error: Client connection negotiation failed: client connection to 127.19.59.65:34927: connect: Connection refused (error 111)
I20260812 00:06:49.051128 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 790
I20260812 00:06:49.058163 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 339
I20260812 00:06:49.072018 19693 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 00:06:49.416505 19693 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 00:06:49.416625 19693 mini_ranger.cc:66] Stopping Ranger...
I20260812 00:06:49.761014 19693 mini_ranger.cc:68] Stopped Ranger
2026-08-12 00:06:49.761 UTC [32317] LOG: received smart shutdown request
2026-08-12 00:06:49.765 UTC [32317] LOG: background worker "logical replication launcher" (PID 32328) exited with exit code 1
2026-08-12 00:06:49.765 UTC [32321] LOG: shutting down
2026-08-12 00:06:49.941 UTC [32317] LOG: database system is shut down
2026-08-12T00:06:49Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (45368 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:06:50 dist-test-slave-6nmv krb5kdc[1005](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:06:50 dist-test-slave-6nmv krb5kdc[1005](info): set up 2 sockets
Aug 12 00:06:50 dist-test-slave-6nmv krb5kdc[1005](info): commencing operation
krb5kdc: starting...
W20260812 00:06:51.154930 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.081s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:06:51 dist-test-slave-6nmv krb5kdc[1005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493211, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:51Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.19.59.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.19.59.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/rangeradmin_127.19.59.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/rangeradmin_127.19.59.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.19.59.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.19.59.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/rangerlookup_127.19.59.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/rangerlookup_127.19.59.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.59.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.19.59.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/HTTP_127.19.59.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/HTTP_127.19.59.84@KRBTEST.COM.keytab.
I20260812 00:06:51.320504 19693 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskBmexS9/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/postgres -l logfile start
2026-08-12 00:06:53.808 UTC [1041] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 00:06:53.809 UTC [1041] LOG: listening on IPv4 address "127.19.59.84", port 49395
2026-08-12 00:06:53.812 UTC [1041] LOG: listening on Unix socket "/tmp/.s.PGSQL.49395"
2026-08-12 00:06:53.832 UTC [1044] LOG: database system was shut down at 2026-08-12 00:06:52 UTC
2026-08-12 00:06:53.836 UTC [1041] LOG: database system is ready to accept connections
I20260812 00:06:54.815266 19693 mini_postgres.cc:96] Postgres bound to 49395
2026-08-12 00:06:54.822 UTC [1055] FATAL: database "slave" does not exist
127.19.59.84:49395 - accepting connections
I20260812 00:06:54.822978 19693 mini_ranger.cc:161] Starting Ranger...
I20260812 00:06:54.836957 19693 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 00:06:55.332978 19693 mini_ranger.cc:87] Created ranger Postgres database
I20260812 00:06:55.333062 19693 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-admin
2026-08-12 00:06:55,594 [I] DB FLAVOR :POSTGRES
2026-08-12 00:06:55,594 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:06:55,594 [I] Checking connection..
2026-08-12 00:06:55,594 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 00:06:55,846 [I] Checking connection passed.
2026-08-12 00:06:55,847 [I] --------- Verifying version history table ---------
2026-08-12 00:06:55,847 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:06:56,087 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:06:56,088 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:06:56,343 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:06:56,343 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 00:06:56,343 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 00:06:56.594 UTC [1127] WARNING: there is no transaction in progress
2026-08-12 00:06:56,600 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 00:06:56,601 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:06:56,866 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 00:06:56,866 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:06:56,866 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 00:06:57,099 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 00:06:57,351 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-6nmv.c.gcp-upstream.internal','N') ;"
2026-08-12 00:06:57,580 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:06:57,807 [I] Table x_portal_user does not exist in database ranger
2026-08-12 00:06:57,807 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:06:58,049 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 00:06:58,049 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:06:58,282 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:06:58,526 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 00:06:58,527 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 00:06:59.439 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:06:59.454 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:06:59.468 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:06:59.484 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:06:59.499 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:06:59.517 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:06:59.568 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:06:59.574 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:06:59.587 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:06:59.597 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:06:59.606 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:06:59.619 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:06:59.627 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:06:59.634 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:06:59.640 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:06:59.646 UTC [1251] WARNING: there is no transaction in progress
2026-08-12 00:07:00,286 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 00:07:00,287 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 00:07:00,534 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 00:07:00,534 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:07:00,768 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 00:07:00,769 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:07:01,014 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 00:07:01,014 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:07:01,261 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:07:01,497 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-6nmv.c.gcp-upstream.internal';"
2026-08-12 00:07:01,732 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 00:07:01,733 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 00:07:01,976 [I] DB_PATCHES have already been applied
I20260812 00:07:01.982306 19693 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-admin:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskBmexS9/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 00:07:01.982402 19693 mini_ranger.cc:193] Using host: 127.19.59.84
I20260812 00:07:01.985890 19693 mini_ranger.cc:227] Ranger admin URL: http://127.19.59.84:50417
Aug 12, 2026 12:07:02 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:07:02 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:07:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 12:07:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 12:07:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 12:07:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 12:07:02 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 00:07:03.158799 19693 mini_ranger.cc:160] Time spent starting Ranger: real 8.336s user 0.000s sys 0.009s
Aug 12, 2026 12:07:22 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 12:07:22 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 12:07:22 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 12:07:23 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 12:07:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 12:07:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 12:07:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 12:07:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 12:07:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 12:07:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 12:07:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 12:07:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 12:07:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 12:07:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 12:07:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 12:07:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 12:07:23 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 12:07:23 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 00:07:24.599741 19693 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.19.59.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.19.59.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/rangerkms_127.19.59.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.19.59.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/rangerkms_127.19.59.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.59.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.19.59.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.59.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/HTTP_127.19.59.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.59.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/HTTP_127.19.59.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 00:07:24 dist-test-slave-6nmv krb5kdc[1005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493244, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 00:07:24.682276 19693 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 00:07:24.692036 19693 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 00:07:25.478418 19693 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 00:07:25.478515 19693 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-kms
I20260812 00:07:25.478533 19693 mini_ranger_kms.cc:227] Using postgres at 127.19.59.84:49395
2026-08-12 00:07:25,639 [I] DB FLAVOR :POSTGRES
2026-08-12 00:07:25,639 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:07:25,639 [I] Checking connection
2026-08-12 00:07:25,639 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 00:07:25,857 [I] connection success
2026-08-12 00:07:25,857 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 00:07:25,857 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 00:07:25,857 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 00:07:26,093 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 00:07:26,094 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:07:26,094 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 00:07:26,094 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.59.84:49395/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 00:07:26,341 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 00:07:26.775933 19693 mini_ranger_kms.cc:310] Created kms service
I20260812 00:07:26.958110 19693 mini_ranger_kms.cc:326] Created kudu user
I20260812 00:07:27.001343 19693 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 00:07:26 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493244, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:07:27.369488 19693 mini_ranger_kms.cc:384] Added ranger policy
I20260812 00:07:27.369594 19693 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-kms:/tmp/dist-test-taskBmexS9/build/release/bin/postgresql.jar:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskBmexS9/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 00:07:27.369611 19693 mini_ranger_kms.cc:240] Using host: 127.19.59.84
I20260812 00:07:27.373591 19693 mini_ranger_kms.cc:276] Ranger KMS PID: 1468
I20260812 00:07:27.373672 19693 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.19.59.84:48927
Aug 12, 2026 12:07:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:07:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:07:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 12:07:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 12:07:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 12:07:28 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260812 00:07:29.611021 19693 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 4.929s user 0.004s sys 0.140s
I20260812 00:07:29.611127 19693 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 00:07:29.611183 19693 mini_ranger_kms.cc:401] 127.19.59.84:48927/kms/v1/keys
Aug 12 00:07:29 dist-test-slave-6nmv krb5kdc[1005](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786493249, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.59.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 12 00:07:30 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493249, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.59.84@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
Aug 12 00:07:30 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493249, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.59.84@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
Aug 12 00:07:32 dist-test-slave-6nmv krb5kdc[1005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:07:32.430549 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:45775
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:45775
--ranger_config_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.59.84:48927/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:07:32.506278 1530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:32.506456 1530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:32.506476 1530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:32.507491 1530 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:07:32.507529 1530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:32.507540 1530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:32.507551 1530 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:07:32.507561 1530 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:07:32.508961 1530 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/wal
--ranger_kms_url=127.19.59.84:48927/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:45775
--ranger_config_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:45775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:32.509186 1530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:32.509413 1530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:32.515297 1535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:32.515290 1537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:32.515475 1530 server_base.cc:1034] running on GCE node
W20260812 00:07:32.515290 1539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:32.515808 1530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:32.516098 1530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:32.517257 1530 hybrid_clock.cc:648] HybridClock initialized: now 1786493252517247 us; error 29 us; skew 500 ppm
Aug 12 00:07:32 dist-test-slave-6nmv krb5kdc[1005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493252, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:32.525030 1530 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:07:32.525556 1530 webserver.cc:460] Webserver started at http://127.19.59.126:37087/ using document root <none> and password file <none>
I20260812 00:07:32.525789 1530 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:32.525873 1530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:32.526021 1530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:07:32 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493252, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:07:32.583868 1530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "cd2b24341fea47158be371f38bd4124f"
format_stamp: "Formatted at 2026-08-12 00:07:32 on dist-test-slave-6nmv"
server_key: "70e6cdf704216d46702d399102a1ea9c"
server_key_iv: "cee28bb639e221af7d4167c075b34047"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:32.584311 1530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "cd2b24341fea47158be371f38bd4124f"
format_stamp: "Formatted at 2026-08-12 00:07:32 on dist-test-slave-6nmv"
server_key: "70e6cdf704216d46702d399102a1ea9c"
server_key_iv: "cee28bb639e221af7d4167c075b34047"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:32.585928 1530 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260812 00:07:32.599136 1548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:32.599331 1530 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:07:32.599421 1530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "cd2b24341fea47158be371f38bd4124f"
format_stamp: "Formatted at 2026-08-12 00:07:32 on dist-test-slave-6nmv"
server_key: "70e6cdf704216d46702d399102a1ea9c"
server_key_iv: "cee28bb639e221af7d4167c075b34047"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:32.599498 1530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:32.623333 1530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:32.625265 1530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:32.625427 1530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:32.629875 1530 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:45775
I20260812 00:07:32.629906 1604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:45775 every 8 connection(s)
I20260812 00:07:32.630250 1530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:07:32.630880 1605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:07:32.633035 1605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f: Bootstrap starting.
I20260812 00:07:32.633570 1605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f: Neither blocks nor log segments found. Creating new log.
I20260812 00:07:32.633914 1605 log.cc:824] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:32.634583 1605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f: No bootstrap required, opened a new log
I20260812 00:07:32.636147 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 1530
I20260812 00:07:32.636242 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:07:32.636408 19693 external_mini_cluster.cc:1428] Setting key 5acce7dd2e0b476c5a0713bb288bc0b6
I20260812 00:07:32.636834 1605 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2b24341fea47158be371f38bd4124f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45775 } }
I20260812 00:07:32.637087 1605 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:07:32.637141 1605 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd2b24341fea47158be371f38bd4124f, State: Initialized, Role: FOLLOWER
I20260812 00:07:32.637277 1605 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2b24341fea47158be371f38bd4124f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45775 } }
I20260812 00:07:32.637451 1605 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:07:32.637506 1605 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:07:32.637570 1605 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:07:32.638294 1605 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2b24341fea47158be371f38bd4124f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45775 } }
I20260812 00:07:32.638411 1605 leader_election.cc:302] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd2b24341fea47158be371f38bd4124f; no voters:
I20260812 00:07:32.638587 1605 leader_election.cc:288] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:07:32.638631 1611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:07:32.638847 1611 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 1 LEADER]: Becoming Leader. State: Replica: cd2b24341fea47158be371f38bd4124f, State: Running, Role: LEADER
I20260812 00:07:32.638949 1605 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:07:32.638979 1611 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2b24341fea47158be371f38bd4124f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45775 } }
I20260812 00:07:32.639325 1611 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd2b24341fea47158be371f38bd4124f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2b24341fea47158be371f38bd4124f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45775 } } }
I20260812 00:07:32.639477 1611 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [sys.catalog]: This master's current role is: LEADER
I20260812 00:07:32.639701 1612 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd2b24341fea47158be371f38bd4124f. Latest consensus state: current_term: 1 leader_uuid: "cd2b24341fea47158be371f38bd4124f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2b24341fea47158be371f38bd4124f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45775 } } }
I20260812 00:07:32.639833 1612 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [sys.catalog]: This master's current role is: LEADER
I20260812 00:07:32.640300 1605 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 00:07:32.640728 1627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:07:32.643574 1627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 00:07:32 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:32.646984 1627 catalog_manager.cc:1347] Generated new cluster ID: 0428689e165f47d18ff389635529f55b
I20260812 00:07:32.647038 1627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:07:32.651100 1610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:32.636882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54288 (local address 127.19.59.126:45775)
0812 00:07:32.637060 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:32.637068 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:32.637094 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:07:32.637208 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:32.637215 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:32.637262 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:32.637392 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:32.638132 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:32.639563 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:32.640587 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:32.643356 (+ 2769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:32.643545 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:32.646776 (+ 3231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:32.646780 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:32.646781 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:32.646793 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:32.649019 (+ 2226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:32.649377 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:32.649380 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:32.649380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:32.649487 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:32.649687 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:32.649688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:32.649688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:32.650052 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:32.650208 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:32.650681 (+ 473us) server_negotiation.cc:299] Negotiation successful
0812 00:07:32.650851 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":75,"threads_started":1}
I20260812 00:07:32.669925 1627 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:07:32.670688 1627 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:07:32.679422 1627 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f: Generated new TSK 0
I20260812 00:07:32.679661 1627 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:07:33.366741 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.59.84:48927/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:45775
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:07:33.447078 1658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:33.447278 1658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:33.447312 1658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:33.448357 1658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:33.448426 1658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:33.448467 1658 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:07:33.449905 1658 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.19.59.84:48927/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:45775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:33.450124 1658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:33.450366 1658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:33.455152 1664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:33.455120 1663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:33.455428 1667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:33.455953 1658 server_base.cc:1034] running on GCE node
I20260812 00:07:33.456146 1658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:33.456413 1658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:33.457557 1658 hybrid_clock.cc:648] HybridClock initialized: now 1786493253457542 us; error 34 us; skew 500 ppm
Aug 12 00:07:33 dist-test-slave-6nmv krb5kdc[1005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493253, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:33.459901 1658 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:07:33.460278 1658 webserver.cc:460] Webserver started at http://127.19.59.65:41121/ using document root <none> and password file <none>
I20260812 00:07:33.460542 1658 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:33.460606 1658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:33.460747 1658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:07:33 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493253, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:07:33.472214 1658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "054db65d304b40cdb7883f9e7bd402c0"
format_stamp: "Formatted at 2026-08-12 00:07:33 on dist-test-slave-6nmv"
server_key: "d1c3d9a88372086016ba99d7aca201bb"
server_key_iv: "4f51be8e0af53f0bb3170ff702af703f"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:33.472755 1658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "054db65d304b40cdb7883f9e7bd402c0"
format_stamp: "Formatted at 2026-08-12 00:07:33 on dist-test-slave-6nmv"
server_key: "d1c3d9a88372086016ba99d7aca201bb"
server_key_iv: "4f51be8e0af53f0bb3170ff702af703f"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:33.474717 1658 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260812 00:07:33.488543 1675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:33.488821 1658 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:07:33.488938 1658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "054db65d304b40cdb7883f9e7bd402c0"
format_stamp: "Formatted at 2026-08-12 00:07:33 on dist-test-slave-6nmv"
server_key: "d1c3d9a88372086016ba99d7aca201bb"
server_key_iv: "4f51be8e0af53f0bb3170ff702af703f"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:33.489046 1658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:33.514745 1658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:33.516721 1658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:33.516865 1658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:33.517093 1658 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:07:33.517498 1658 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:07:33.517552 1658 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:33.517617 1658 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:07:33.517663 1658 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:33.523412 1658 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:40981
I20260812 00:07:33.523676 1805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:40981 every 8 connection(s)
I20260812 00:07:33.523929 1658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:07:33.534133 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 1658
I20260812 00:07:33.534253 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:07:33.534458 19693 external_mini_cluster.cc:1428] Setting key fbe9f382a958224a3c90b3fd86882b91
Aug 12 00:07:33 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493253, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:33.538383 1808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:33.524693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:44937 (local address 127.19.59.126:45775)
0812 00:07:33.529640 (+ 4947us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:33.529642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:33.529789 (+ 147us) server_negotiation.cc:407] Connection header received
0812 00:07:33.530369 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:33.530370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:33.530382 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:33.530450 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:33.530929 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:33.531478 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:33.532637 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:33.532849 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:33.532926 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:33.535150 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:33.535151 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:33.535152 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:33.535158 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:33.536988 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:33.537449 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:33.537450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:33.537450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:33.537513 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:33.537751 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:33.537752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:33.537752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:33.537901 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:33.537970 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:33.538216 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 00:07:33.538299 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4919,"thread_start_us":80,"threads_started":1}
I20260812 00:07:33.538668 1809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:33.524673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:45775 (local address 127.19.59.65:44937)
0812 00:07:33.529681 (+ 5008us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:33.529710 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:33.530272 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:33.530521 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:33.530524 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:33.530675 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:33.530839 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:33.530842 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:33.531590 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:33.531592 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:33.532526 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:33.532529 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:33.532947 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:33.532949 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:33.533051 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:33.533489 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:33.533496 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:33.535031 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:33.537084 (+ 2053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:33.537091 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:33.537093 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:33.537374 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:33.537581 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:33.537581 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:33.537582 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:33.537689 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:33.537962 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:33.537967 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:33.538093 (+ 126us) client_negotiation.cc:769] Sending connection context
0812 00:07:33.538194 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 00:07:33.538316 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4979,"thread_start_us":92,"threads_started":1}
I20260812 00:07:33.539104 1806 heartbeater.cc:347] Connected to a master server at 127.19.59.126:45775
I20260812 00:07:33.539182 1806 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:33.539333 1806 heartbeater.cc:511] Master 127.19.59.126:45775 requested a full tablet report, sending...
I20260812 00:07:33.539852 1566 ts_manager.cc:194] Registered new tserver with Master: 054db65d304b40cdb7883f9e7bd402c0 (127.19.59.65:40981)
I20260812 00:07:33.540597 1566 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:44937
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:07:33.576885 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.59.84:48927/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:45775
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:07:33.685782 1815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:33.686116 1815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:33.686213 1815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:33.687641 1815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:33.687775 1815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:33.687885 1815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:07:33.689731 1815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.19.59.84:48927/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:45775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:33.690311 1815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:33.690603 1815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:33.696815 1825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:33.697191 1824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:33.697423 1827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:33.698453 1815 server_base.cc:1034] running on GCE node
I20260812 00:07:33.698724 1815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:33.698953 1815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:33.700109 1815 hybrid_clock.cc:648] HybridClock initialized: now 1786493253700084 us; error 39 us; skew 500 ppm
Aug 12 00:07:33 dist-test-slave-6nmv krb5kdc[1005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493253, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:33.703372 1815 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:07:33.703792 1815 webserver.cc:460] Webserver started at http://127.19.59.66:36419/ using document root <none> and password file <none>
I20260812 00:07:33.704026 1815 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:33.704075 1815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:33.704190 1815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:07:33 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493253, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:07:33.718777 1815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "de36c942fc63421a90f8b8958f8223f9"
format_stamp: "Formatted at 2026-08-12 00:07:33 on dist-test-slave-6nmv"
server_key: "50ddbfdf55c069bdd21a93613f6520ff"
server_key_iv: "1043db6f7ba86ce265488e569082e86e"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:33.719213 1815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "de36c942fc63421a90f8b8958f8223f9"
format_stamp: "Formatted at 2026-08-12 00:07:33 on dist-test-slave-6nmv"
server_key: "50ddbfdf55c069bdd21a93613f6520ff"
server_key_iv: "1043db6f7ba86ce265488e569082e86e"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:33.724960 1815 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.000s
I20260812 00:07:33.740756 1834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:33.740967 1815 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:07:33.741041 1815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "de36c942fc63421a90f8b8958f8223f9"
format_stamp: "Formatted at 2026-08-12 00:07:33 on dist-test-slave-6nmv"
server_key: "50ddbfdf55c069bdd21a93613f6520ff"
server_key_iv: "1043db6f7ba86ce265488e569082e86e"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:33.741111 1815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 12 00:07:33 dist-test-slave-6nmv krb5kdc[1005](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786493253, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:33.761878 1815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:33.763972 1815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:33.764140 1815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:33.764379 1815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:07:33.764775 1815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:07:33.764854 1815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:33.764927 1815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:07:33.764984 1815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:33.771454 1815 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:44765
I20260812 00:07:33.771963 1815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:07:33.773998 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 1815
I20260812 00:07:33.774111 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:07:33.774241 1967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:44765 every 8 connection(s)
I20260812 00:07:33.774291 19693 external_mini_cluster.cc:1428] Setting key 7af795f57fea4397f830b94b154f0ad5
Aug 12 00:07:33 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493253, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:33.788064 1808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:33.774555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:39077 (local address 127.19.59.126:45775)
0812 00:07:33.774776 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:33.774779 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:33.778241 (+ 3462us) server_negotiation.cc:407] Connection header received
0812 00:07:33.778895 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:33.778897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:33.778912 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:33.778940 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:33.779767 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:33.780584 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:33.781993 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:33.782297 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:33.782379 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:33.785010 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:33.785011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:33.785011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:33.785019 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:33.786675 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:33.787089 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:33.787090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:33.787090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:33.787139 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:33.787406 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:33.787407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:33.787407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:33.787520 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:33.787558 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:33.787877 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 00:07:33.787981 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194}
I20260812 00:07:33.788749 1970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:33.774225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:45775 (local address 127.19.59.66:39077)
0812 00:07:33.778125 (+ 3900us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:33.778169 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:33.778787 (+ 618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:33.779103 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:33.779107 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:33.779397 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:33.779656 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:33.779662 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:33.780705 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:33.780705 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:33.781904 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:33.781907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:33.782532 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:33.782532 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:33.782688 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:33.783259 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:33.783269 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:33.784902 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:33.786762 (+ 1860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:33.786767 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:33.786769 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:33.787013 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:33.787195 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:33.787195 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:33.787195 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:33.787316 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:33.787598 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:33.787604 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:33.787735 (+ 131us) client_negotiation.cc:769] Sending connection context
0812 00:07:33.788396 (+ 661us) client_negotiation.cc:240] Negotiation successful
0812 00:07:33.788542 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3861,"thread_start_us":87,"threads_started":1}
I20260812 00:07:33.789465 1968 heartbeater.cc:347] Connected to a master server at 127.19.59.126:45775
I20260812 00:07:33.789556 1968 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:33.789732 1968 heartbeater.cc:511] Master 127.19.59.126:45775 requested a full tablet report, sending...
I20260812 00:07:33.790169 1566 ts_manager.cc:194] Registered new tserver with Master: de36c942fc63421a90f8b8958f8223f9 (127.19.59.66:44765)
I20260812 00:07:33.790637 1566 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:39077
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:07:33.834596 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.59.84:48927/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:45775
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:07:33.949062 1973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:33.949311 1973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:33.949362 1973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:33.951051 1973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:33.951117 1973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:33.951160 1973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:07:33.953173 1973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.19.59.84:48927/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:45775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:33.953388 1973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:33.953691 1973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:33.959031 1983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:33.959203 1981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:33.959116 1980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:33.960314 1973 server_base.cc:1034] running on GCE node
I20260812 00:07:33.960522 1973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:33.960737 1973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:33.961856 1973 hybrid_clock.cc:648] HybridClock initialized: now 1786493253961841 us; error 33 us; skew 500 ppm
Aug 12 00:07:33 dist-test-slave-6nmv krb5kdc[1005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493253, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:33.964762 1973 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:07:33.965214 1973 webserver.cc:460] Webserver started at http://127.19.59.67:44637/ using document root <none> and password file <none>
I20260812 00:07:33.965445 1973 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:33.965497 1973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:33.965657 1973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:07:33 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493253, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:07:33.982097 1973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70"
format_stamp: "Formatted at 2026-08-12 00:07:33 on dist-test-slave-6nmv"
server_key: "a03ab3fccdf5e37570446868dd34f8a6"
server_key_iv: "543ce553f6f9ca4e89793a14c6e140e0"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:33.982547 1973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70"
format_stamp: "Formatted at 2026-08-12 00:07:33 on dist-test-slave-6nmv"
server_key: "a03ab3fccdf5e37570446868dd34f8a6"
server_key_iv: "543ce553f6f9ca4e89793a14c6e140e0"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:33.985191 1973 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:07:34.004770 1993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:34.005007 1973 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260812 00:07:34.005120 1973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70"
format_stamp: "Formatted at 2026-08-12 00:07:33 on dist-test-slave-6nmv"
server_key: "a03ab3fccdf5e37570446868dd34f8a6"
server_key_iv: "543ce553f6f9ca4e89793a14c6e140e0"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:34.005203 1973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:34.017745 1973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:34.020032 1973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:34.020208 1973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:34.020437 1973 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:07:34.020799 1973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:07:34.020880 1973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:34.020957 1973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:07:34.021030 1973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:34.027704 1973 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:36985
I20260812 00:07:34.028143 1973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:07:34.028607 2138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:36985 every 8 connection(s)
Aug 12 00:07:34 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493253, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:34.038086 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 1973
I20260812 00:07:34.038192 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:07:34.038405 19693 external_mini_cluster.cc:1428] Setting key 8a1099d6e7dfc95f5a6e4242f71ed28c
I20260812 00:07:34.039984 1808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:34.029100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:60549 (local address 127.19.59.126:45775)
0812 00:07:34.029167 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:34.029169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:34.029181 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:07:34.029743 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:34.029744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:34.029759 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:34.029855 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:34.030482 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.031162 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.032629 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.032947 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.032996 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:34.035782 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:34.035783 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:34.035784 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:34.035790 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:34.037542 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:34.038812 (+ 1270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:34.038813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:34.038814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:34.038894 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:34.039205 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:34.039206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:34.039206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:34.039350 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:34.039407 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:34.039776 (+ 369us) server_negotiation.cc:299] Negotiation successful
0812 00:07:34.039887 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 00:07:34.040105 2141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:34.028801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:45775 (local address 127.19.59.67:60549)
0812 00:07:34.028959 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:34.028997 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:34.029623 (+ 626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:34.029943 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:34.029947 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:34.030148 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:34.030380 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:34.030386 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.031280 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.031282 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:34.032509 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:34.032512 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.033114 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.033115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:34.033240 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:34.033812 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:34.033846 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:34.035653 (+ 1807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:34.037645 (+ 1992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:34.037651 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:34.037652 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:34.038706 (+ 1054us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:34.038985 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:34.038986 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:34.038986 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:34.039118 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:34.039446 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:34.039453 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:34.039597 (+ 144us) client_negotiation.cc:769] Sending connection context
0812 00:07:34.039726 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 00:07:34.039891 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":103,"threads_started":1}
I20260812 00:07:34.040804 2139 heartbeater.cc:347] Connected to a master server at 127.19.59.126:45775
I20260812 00:07:34.040913 2139 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:34.041147 2139 heartbeater.cc:511] Master 127.19.59.126:45775 requested a full tablet report, sending...
I20260812 00:07:34.041554 1566 ts_manager.cc:194] Registered new tserver with Master: 20c28b9d6e2f4f0cb70d7b92450bfa70 (127.19.59.67:36985)
I20260812 00:07:34.042018 1566 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:60549
I20260812 00:07:34.054307 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:07:34.055042 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 1658
I20260812 00:07:34.062750 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 1815
I20260812 00:07:34.069403 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 1973
I20260812 00:07:34.093896 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 1530
I20260812 00:07:34.102689 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:45775
--webserver_interface=127.19.59.126
--webserver_port=37087
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:45775
--ranger_config_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.59.84:48927/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.59.84:48927/kms with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:07:34.177644 2142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:34.177860 2142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:34.177892 2142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:34.178901 2142 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:07:34.178961 2142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:34.178984 2142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:34.179011 2142 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:07:34.179033 2142 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:07:34.180368 2142 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.59.84:48927/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:45775
--ranger_config_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:45775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=37087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:34.180600 2142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:34.180787 2142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:34.186094 2148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:34.186287 2142 server_base.cc:1034] running on GCE node
W20260812 00:07:34.186357 2151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:34.186100 2147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:34.186611 2142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:34.186888 2142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:34.188063 2142 hybrid_clock.cc:648] HybridClock initialized: now 1786493254188042 us; error 35 us; skew 500 ppm
Aug 12 00:07:34 dist-test-slave-6nmv krb5kdc[1005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493254, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:34.190557 2142 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:07:34.191021 2142 webserver.cc:460] Webserver started at http://127.19.59.126:37087/ using document root <none> and password file <none>
I20260812 00:07:34.191238 2142 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:34.191299 2142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:07:34 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493254, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:07:34.266633 2142 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:07:34.267452 2160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:34.267609 2142 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:07:34.267707 2142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "cd2b24341fea47158be371f38bd4124f"
format_stamp: "Formatted at 2026-08-12 00:07:32 on dist-test-slave-6nmv"
server_key: "70e6cdf704216d46702d399102a1ea9c"
server_key_iv: "cee28bb639e221af7d4167c075b34047"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:34.268097 2142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:34.281682 2142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:34.283753 2142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:34.283919 2142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:34.288097 2142 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:45775
I20260812 00:07:34.288141 2226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:45775 every 8 connection(s)
I20260812 00:07:34.288483 2142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:07:34.288692 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 2142
I20260812 00:07:34.288997 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.59.84:48927/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:40981
--local_ip_for_outbound_sockets=127.19.59.65
--tserver_master_addrs=127.19.59.126:45775
--webserver_port=41121
--webserver_interface=127.19.59.65
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.59.84:48927/kms with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:07:34.289774 2227 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:07:34.290407 2227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f: Bootstrap starting.
I20260812 00:07:34.298035 2227 log.cc:824] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:34.299657 2227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:07:34.299921 2227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f: Bootstrap complete.
I20260812 00:07:34.302186 2227 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2b24341fea47158be371f38bd4124f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45775 } }
I20260812 00:07:34.302420 2227 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd2b24341fea47158be371f38bd4124f, State: Initialized, Role: FOLLOWER
I20260812 00:07:34.302608 2227 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2b24341fea47158be371f38bd4124f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45775 } }
I20260812 00:07:34.302700 2227 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:07:34.302748 2227 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:07:34.302791 2227 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:07:34.303721 2227 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2b24341fea47158be371f38bd4124f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45775 } }
I20260812 00:07:34.303854 2227 leader_election.cc:302] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd2b24341fea47158be371f38bd4124f; no voters:
I20260812 00:07:34.304006 2227 leader_election.cc:288] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:07:34.304039 2231 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:07:34.304145 2231 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [term 2 LEADER]: Becoming Leader. State: Replica: cd2b24341fea47158be371f38bd4124f, State: Running, Role: LEADER
I20260812 00:07:34.304257 2227 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:07:34.304291 2231 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2b24341fea47158be371f38bd4124f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45775 } }
I20260812 00:07:34.304618 2231 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd2b24341fea47158be371f38bd4124f. Latest consensus state: current_term: 2 leader_uuid: "cd2b24341fea47158be371f38bd4124f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2b24341fea47158be371f38bd4124f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45775 } } }
I20260812 00:07:34.304622 2232 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "cd2b24341fea47158be371f38bd4124f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2b24341fea47158be371f38bd4124f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 45775 } } }
I20260812 00:07:34.304803 2231 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [sys.catalog]: This master's current role is: LEADER
I20260812 00:07:34.304909 2232 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f [sys.catalog]: This master's current role is: LEADER
I20260812 00:07:34.305117 2240 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:07:34.305779 2240 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:07:34.305925 2240 catalog_manager.cc:1259] Loaded cluster ID: 0428689e165f47d18ff389635529f55b
I20260812 00:07:34.306011 2240 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:07:34.306226 2227 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 00:07:34.307191 2240 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:07:34.307358 2240 catalog_manager.cc:5879] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f: Loaded TSK: 0
I20260812 00:07:34.307560 2240 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:07:34.391697 2229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:34.392084 2229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:34.392153 2229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:34.394222 2229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:34.394318 2229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:34.394402 2229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:07:34.396080 2229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.59.84:48927/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:40981
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=41121
--tserver_master_addrs=127.19.59.126:45775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:34.396315 2229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:34.396588 2229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:34.402159 2271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:34.402314 2268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:34.402606 2229 server_base.cc:1034] running on GCE node
W20260812 00:07:34.402700 2267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:34.402907 2229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:34.403215 2229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:34.404372 2229 hybrid_clock.cc:648] HybridClock initialized: now 1786493254404344 us; error 41 us; skew 500 ppm
Aug 12 00:07:34 dist-test-slave-6nmv krb5kdc[1005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493254, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:34.407217 2229 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:07:34.407696 2229 webserver.cc:460] Webserver started at http://127.19.59.65:41121/ using document root <none> and password file <none>
I20260812 00:07:34.407927 2229 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:34.408011 2229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:07:34 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493254, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:07:34.426447 2229 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:07:34.427963 2279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:34.428134 2229 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:07:34.428200 2229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "054db65d304b40cdb7883f9e7bd402c0"
format_stamp: "Formatted at 2026-08-12 00:07:33 on dist-test-slave-6nmv"
server_key: "d1c3d9a88372086016ba99d7aca201bb"
server_key_iv: "4f51be8e0af53f0bb3170ff702af703f"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:34.428565 2229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:34.447497 2229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:34.449493 2229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:34.449649 2229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:34.449860 2229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:07:34.450214 2229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:07:34.450273 2229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:34.450335 2229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:07:34.450366 2229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:34.457298 2229 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:40981
I20260812 00:07:34.457756 2229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:07:34.458309 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 2229
I20260812 00:07:34.458484 2405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:40981 every 8 connection(s)
I20260812 00:07:34.458624 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.59.84:48927/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:44765
--local_ip_for_outbound_sockets=127.19.59.66
--tserver_master_addrs=127.19.59.126:45775
--webserver_port=36419
--webserver_interface=127.19.59.66
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.59.84:48927/kms with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:07:34 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493254, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:34.479496 2409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:34.460539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:45775 (local address 127.19.59.65:43793)
0812 00:07:34.460742 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:34.460789 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:34.461385 (+ 596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:34.468524 (+ 7139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:34.468529 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:34.468947 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:34.469369 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:34.469377 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.470969 (+ 1592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.470970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:34.472118 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:34.472122 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.472961 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.472962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:34.473084 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:34.473772 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:34.473781 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:34.475421 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:34.477562 (+ 2141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:34.477568 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:34.477570 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:34.477909 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:34.478224 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:34.478225 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:34.478225 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:34.478355 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:34.478850 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:34.478869 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:34.479007 (+ 138us) client_negotiation.cc:769] Sending connection context
0812 00:07:34.479122 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 00:07:34.479271 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":95,"threads_started":1}
I20260812 00:07:34.479509 2410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:34.460891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:43793 (local address 127.19.59.126:45775)
0812 00:07:34.467807 (+ 6916us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:34.467816 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:34.467894 (+ 78us) server_negotiation.cc:407] Connection header received
0812 00:07:34.468067 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:34.468074 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:34.468208 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:34.468352 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:34.469521 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.470806 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.472235 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.472849 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.472947 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:34.475554 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:34.475559 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:34.475559 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:34.475572 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:34.477469 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:34.478019 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:34.478022 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:34.478022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:34.478139 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:34.478446 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:34.478447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:34.478447 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:34.478733 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:34.478820 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:34.479201 (+ 381us) server_negotiation.cc:299] Negotiation successful
0812 00:07:34.479317 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6856,"thread_start_us":77,"threads_started":1}
I20260812 00:07:34.480597 2406 heartbeater.cc:347] Connected to a master server at 127.19.59.126:45775
I20260812 00:07:34.480688 2406 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:34.480921 2406 heartbeater.cc:511] Master 127.19.59.126:45775 requested a full tablet report, sending...
W20260812 00:07:34.481781 2406 heartbeater.cc:644] Failed to heartbeat to 127.19.59.126:45775 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:07:34.481889 2406 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:34.481983 2406 heartbeater.cc:511] Master 127.19.59.126:45775 requested a full tablet report, sending...
I20260812 00:07:34.482290 2406 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:34.482358 2406 heartbeater.cc:511] Master 127.19.59.126:45775 requested a full tablet report, sending...
W20260812 00:07:34.482621 2406 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:07:34.552165 2408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:34.552408 2408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:34.552446 2408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:34.554023 2408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:34.554140 2408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:34.554212 2408 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:07:34.556257 2408 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.59.84:48927/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:44765
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=36419
--tserver_master_addrs=127.19.59.126:45775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:34.556445 2408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:34.556661 2408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:34.562268 2416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:34.562390 2415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:34.562500 2418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:34.563187 2408 server_base.cc:1034] running on GCE node
I20260812 00:07:34.563400 2408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:34.563683 2408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:34.564847 2408 hybrid_clock.cc:648] HybridClock initialized: now 1786493254564813 us; error 47 us; skew 500 ppm
Aug 12 00:07:34 dist-test-slave-6nmv krb5kdc[1005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493254, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:34.567950 2408 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:07:34.568444 2408 webserver.cc:460] Webserver started at http://127.19.59.66:36419/ using document root <none> and password file <none>
I20260812 00:07:34.568657 2408 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:34.568729 2408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:07:34 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493254, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:07:34.585037 2408 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:07:34.586712 2426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:34.586934 2408 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:07:34.587030 2408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "de36c942fc63421a90f8b8958f8223f9"
format_stamp: "Formatted at 2026-08-12 00:07:33 on dist-test-slave-6nmv"
server_key: "50ddbfdf55c069bdd21a93613f6520ff"
server_key_iv: "1043db6f7ba86ce265488e569082e86e"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:34.587460 2408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:34.610144 2408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:34.612720 2408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:34.612946 2408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:34.613221 2408 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:07:34.613641 2408 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:07:34.613726 2408 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:34.613794 2408 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:07:34.613880 2408 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:34.620618 2408 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:44765
I20260812 00:07:34.621068 2408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:07:34.624378 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 2408
I20260812 00:07:34.624702 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.59.84:48927/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:36985
--local_ip_for_outbound_sockets=127.19.59.67
--tserver_master_addrs=127.19.59.126:45775
--webserver_port=44637
--webserver_interface=127.19.59.67
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.59.84:48927/kms with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:07:34.639008 2549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:44765 every 8 connection(s)
Aug 12 00:07:34 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493254, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:34.650147 2410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:34.639642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:51155 (local address 127.19.59.126:45775)
0812 00:07:34.639712 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:34.639714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:34.640138 (+ 424us) server_negotiation.cc:407] Connection header received
0812 00:07:34.640842 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:34.640843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:34.640886 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:34.640920 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:34.641783 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.642493 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.643883 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.644172 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.644225 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:34.646784 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:34.646785 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:34.646786 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:34.646793 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:34.648638 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:34.649115 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:34.649116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:34.649116 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:34.649173 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:34.649440 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:34.649441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:34.649441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:34.649560 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:34.649599 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:34.649980 (+ 381us) server_negotiation.cc:299] Negotiation successful
0812 00:07:34.650058 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:07:34.650648 2553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:34.639263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:45775 (local address 127.19.59.66:51155)
0812 00:07:34.640000 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:34.640048 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:34.640703 (+ 655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:34.641109 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:34.641114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:34.641359 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:34.641650 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:34.641669 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.642614 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.642615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:34.643762 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:34.643765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.644340 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.644341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:34.644493 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:34.645193 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:34.645203 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:34.646676 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:34.648727 (+ 2051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:34.648733 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:34.648734 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:34.649025 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:34.649235 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:34.649235 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:34.649235 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:34.649350 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:34.649662 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:34.649667 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:34.649832 (+ 165us) client_negotiation.cc:769] Sending connection context
0812 00:07:34.650280 (+ 448us) client_negotiation.cc:240] Negotiation successful
0812 00:07:34.650435 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"thread_start_us":120,"threads_started":1}
I20260812 00:07:34.651222 2550 heartbeater.cc:347] Connected to a master server at 127.19.59.126:45775
I20260812 00:07:34.651302 2550 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:34.651470 2550 heartbeater.cc:511] Master 127.19.59.126:45775 requested a full tablet report, sending...
W20260812 00:07:34.652148 2550 heartbeater.cc:644] Failed to heartbeat to 127.19.59.126:45775 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:07:34.652212 2550 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:34.652269 2550 heartbeater.cc:511] Master 127.19.59.126:45775 requested a full tablet report, sending...
I20260812 00:07:34.652617 2550 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:34.652690 2550 heartbeater.cc:511] Master 127.19.59.126:45775 requested a full tablet report, sending...
W20260812 00:07:34.653029 2550 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:07:34.733286 2552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:34.733719 2552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:34.733840 2552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:34.735491 2552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:34.735594 2552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:34.735682 2552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:07:34.737620 2552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.59.84:48927/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:36985
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=44637
--tserver_master_addrs=127.19.59.126:45775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:34.738051 2552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:34.738327 2552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:34.744351 2558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:34.745210 2552 server_base.cc:1034] running on GCE node
W20260812 00:07:34.746173 2559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:34.746650 2562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:34.746917 2552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:34.747135 2552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:34.748270 2552 hybrid_clock.cc:648] HybridClock initialized: now 1786493254748257 us; error 26 us; skew 500 ppm
Aug 12 00:07:34 dist-test-slave-6nmv krb5kdc[1005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493254, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:34.751055 2552 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:07:34.751479 2552 webserver.cc:460] Webserver started at http://127.19.59.67:44637/ using document root <none> and password file <none>
I20260812 00:07:34.751744 2552 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:34.751817 2552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:07:34 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493254, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:07:34.771871 2552 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:07:34.772970 2571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:34.773172 2552 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:07:34.773263 2552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70"
format_stamp: "Formatted at 2026-08-12 00:07:33 on dist-test-slave-6nmv"
server_key: "a03ab3fccdf5e37570446868dd34f8a6"
server_key_iv: "543ce553f6f9ca4e89793a14c6e140e0"
server_key_version: "kuduclusterkey@0"
I20260812 00:07:34.773660 2552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:34.783792 2552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:34.786065 2552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:34.786235 2552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:34.786478 2552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:07:34.786813 2552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:07:34.786886 2552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:34.786952 2552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:07:34.787000 2552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:34.793555 2552 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:36985
I20260812 00:07:34.794006 2692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:36985 every 8 connection(s)
I20260812 00:07:34.794358 2552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:07:34.800781 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 2552
Aug 12 00:07:34 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493254, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:34.804438 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:34.795199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:45775 (local address 127.19.59.67:36209)
0812 00:07:34.795414 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:34.795478 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:34.796124 (+ 646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:34.796464 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:34.796467 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:34.796663 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:34.796888 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:34.796894 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.797857 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.797857 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:34.798964 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:34.798967 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.799430 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.799431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:34.799553 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:34.800020 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:34.800029 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:34.801490 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:34.803150 (+ 1660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:34.803155 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:34.803157 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:34.803390 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:34.803585 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:34.803586 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:34.803586 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:34.803685 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:34.803913 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:34.803918 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:34.804041 (+ 123us) client_negotiation.cc:769] Sending connection context
0812 00:07:34.804124 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 00:07:34.804244 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":103,"threads_started":1}
I20260812 00:07:34.804973 2410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:34.795245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:36209 (local address 127.19.59.126:45775)
0812 00:07:34.795299 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:34.795301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:34.795567 (+ 266us) server_negotiation.cc:407] Connection header received
0812 00:07:34.796243 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:34.796244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:34.796258 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:34.796286 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:34.797033 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.797715 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.799056 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.799310 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.799380 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:34.801589 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:34.801591 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:34.801591 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:34.801598 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:34.803070 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:34.803479 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:34.803480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:34.803480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:34.803531 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:34.803741 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:34.803741 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:34.803741 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:34.803844 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:34.803892 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:34.804801 (+ 909us) server_negotiation.cc:299] Negotiation successful
0812 00:07:34.804882 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:07:34.805550 2693 heartbeater.cc:347] Connected to a master server at 127.19.59.126:45775
I20260812 00:07:34.805648 2693 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:34.805802 2693 heartbeater.cc:511] Master 127.19.59.126:45775 requested a full tablet report, sending...
W20260812 00:07:34.806342 2693 heartbeater.cc:644] Failed to heartbeat to 127.19.59.126:45775 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:07:34.806406 2693 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:34.806452 2693 heartbeater.cc:511] Master 127.19.59.126:45775 requested a full tablet report, sending...
I20260812 00:07:34.806720 2693 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:34.806777 2693 heartbeater.cc:511] Master 127.19.59.126:45775 requested a full tablet report, sending...
W20260812 00:07:34.807024 2693 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:07:34.809201 2698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:34.801126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39204 (local address 127.19.59.126:45775)
0812 00:07:34.802028 (+ 902us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:34.802030 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:34.802036 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:07:34.802055 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:34.802055 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:34.802065 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:34.802128 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:34.802904 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.803551 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.804527 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:34.804815 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:34.804880 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:34.806600 (+ 1720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:34.806602 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:34.806602 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:34.806608 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:34.808122 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:34.808489 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:34.808490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:34.808490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:34.808545 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:34.808739 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:34.808739 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:34.808740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:34.808854 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:34.808986 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:34.809046 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 00:07:34.809116 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":880,"thread_start_us":83,"threads_started":1}
Aug 12 00:07:35 dist-test-slave-6nmv krb5kdc[1005](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786493255, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:35.482826 2406 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:35.482982 2406 heartbeater.cc:511] Master 127.19.59.126:45775 requested a full tablet report, sending...
I20260812 00:07:35.483351 2185 ts_manager.cc:194] Registered new tserver with Master: 054db65d304b40cdb7883f9e7bd402c0 (127.19.59.65:40981)
I20260812 00:07:35.484285 2185 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:43793
I20260812 00:07:35.653211 2550 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:35.653373 2550 heartbeater.cc:511] Master 127.19.59.126:45775 requested a full tablet report, sending...
I20260812 00:07:35.653671 2185 ts_manager.cc:194] Registered new tserver with Master: de36c942fc63421a90f8b8958f8223f9 (127.19.59.66:44765)
I20260812 00:07:35.654193 2185 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:51155
Aug 12 00:07:35 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493255, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
I20260812 00:07:35.807176 2693 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:35.807328 2693 heartbeater.cc:511] Master 127.19.59.126:45775 requested a full tablet report, sending...
I20260812 00:07:35.807611 2185 ts_manager.cc:194] Registered new tserver with Master: 20c28b9d6e2f4f0cb70d7b92450bfa70 (127.19.59.67:36985)
I20260812 00:07:35.808007 2185 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:36209
I20260812 00:07:35.816756 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:07:35.827900 2720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:35.817801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39218 (local address 127.19.59.126:45775)
0812 00:07:35.821909 (+ 4108us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:35.821911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:35.821917 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:07:35.821934 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:35.821934 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:35.821946 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:35.822022 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:35.822561 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:35.823046 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:35.823762 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:35.823989 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:35.824060 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:35.825366 (+ 1306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:35.825368 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:35.825368 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:35.825375 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:35.826853 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:35.827188 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:35.827189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:35.827189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:35.827247 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:35.827426 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:35.827427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:35.827427 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:35.827528 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:35.827621 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:35.827721 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 00:07:35.827797 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4084,"thread_start_us":70,"threads_started":1}
I20260812 00:07:35.829644 2185 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39218:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:07:35.831321 2185 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:07:35.837615 2736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:35.833937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:44765 (local address 127.0.0.1:48316)
0812 00:07:35.834352 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:35.834392 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:35.834454 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:35.834928 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:35.834931 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:35.834933 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:07:35.835027 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:35.835029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:35.835916 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:35.835917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:35.836697 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:35.836700 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:35.837363 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:35.837364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:35.837436 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:35.837446 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 00:07:35.837507 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 00:07:35.837552 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":75,"threads_started":1}
I20260812 00:07:35.837647 2734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:35.834202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48316 (local address 127.19.59.66:44765)
0812 00:07:35.834599 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:35.834605 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:35.834615 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:07:35.834679 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:35.834681 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:35.834765 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:35.835114 (+ 349us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:07:35.835173 (+ 59us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:35.835826 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:35.836777 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:35.837265 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:35.837351 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:35.837405 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:35.837526 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 00:07:35.837567 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":50,"threads_started":1}
I20260812 00:07:35.838620 2481 tablet_service.cc:1467] Processing CreateTablet for tablet cc7b12e4f3d94b84b67ff14adb05dc82 (DEFAULT_TABLE table=test-table [id=7aaed26ab2774325b7761bbf7d69b27d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:07:35.838990 2481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc7b12e4f3d94b84b67ff14adb05dc82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:07:35.843737 2729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:35.833937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:36985 (local address 127.0.0.1:46882)
0812 00:07:35.837911 (+ 3974us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:35.837920 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:35.838149 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:35.838667 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:35.838667 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:35.838668 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:07:35.838706 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:35.838706 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:35.841893 (+ 3187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:35.841894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:35.842843 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:35.842846 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:35.843508 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:35.843508 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:35.843555 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:35.843557 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:07:35.843647 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 00:07:35.843680 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3958,"mutex_wait_us":2,"thread_start_us":72,"threads_started":1}
I20260812 00:07:35.843776 2733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:35.834031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46882 (local address 127.19.59.67:36985)
0812 00:07:35.834560 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:35.834565 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:35.837975 (+ 3410us) server_negotiation.cc:407] Connection header received
0812 00:07:35.838384 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:35.838386 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:35.838400 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:35.838442 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:07:35.839722 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:35.840683 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:35.842923 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:35.843385 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:35.843430 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:35.843461 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:35.843672 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 00:07:35.843709 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":48,"threads_started":1}
I20260812 00:07:35.845196 2738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:35.834391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60720 (local address 127.19.59.65:40981)
0812 00:07:35.834704 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:35.834707 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:35.838075 (+ 3368us) server_negotiation.cc:407] Connection header received
0812 00:07:35.838225 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:35.838227 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:35.838241 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:35.838286 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:07:35.838777 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:35.839629 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:35.843963 (+ 4334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:35.844480 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:35.844516 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:35.844547 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:35.845053 (+ 506us) server_negotiation.cc:299] Negotiation successful
0812 00:07:35.845114 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":66,"threads_started":1}
I20260812 00:07:35.845505 2603 tablet_service.cc:1467] Processing CreateTablet for tablet cc7b12e4f3d94b84b67ff14adb05dc82 (DEFAULT_TABLE table=test-table [id=7aaed26ab2774325b7761bbf7d69b27d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:07:35.845880 2603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc7b12e4f3d94b84b67ff14adb05dc82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:07:35.844885 2728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:35.834219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:40981 (local address 127.0.0.1:60720)
0812 00:07:35.838018 (+ 3799us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:35.838025 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:35.838104 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:35.838542 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:35.838542 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:35.838544 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:07:35.838578 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:35.838579 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:35.840796 (+ 2217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:35.840797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:35.843874 (+ 3077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:35.843877 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:35.844621 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:35.844621 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:35.844690 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:35.844693 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:07:35.844762 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 00:07:35.844798 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3787,"thread_start_us":58,"threads_started":1}
I20260812 00:07:35.849011 2316 tablet_service.cc:1467] Processing CreateTablet for tablet cc7b12e4f3d94b84b67ff14adb05dc82 (DEFAULT_TABLE table=test-table [id=7aaed26ab2774325b7761bbf7d69b27d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:07:35.849298 2316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc7b12e4f3d94b84b67ff14adb05dc82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:07:35.849939 2740 tablet_bootstrap.cc:492] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9: Bootstrap starting.
I20260812 00:07:35.850543 2740 tablet_bootstrap.cc:654] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9: Neither blocks nor log segments found. Creating new log.
I20260812 00:07:35.850826 2740 log.cc:824] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:35.852068 2744 tablet_bootstrap.cc:492] T cc7b12e4f3d94b84b67ff14adb05dc82 P 054db65d304b40cdb7883f9e7bd402c0: Bootstrap starting.
I20260812 00:07:35.852741 2744 tablet_bootstrap.cc:654] T cc7b12e4f3d94b84b67ff14adb05dc82 P 054db65d304b40cdb7883f9e7bd402c0: Neither blocks nor log segments found. Creating new log.
I20260812 00:07:35.853051 2744 log.cc:824] T cc7b12e4f3d94b84b67ff14adb05dc82 P 054db65d304b40cdb7883f9e7bd402c0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:35.853721 2744 tablet_bootstrap.cc:492] T cc7b12e4f3d94b84b67ff14adb05dc82 P 054db65d304b40cdb7883f9e7bd402c0: No bootstrap required, opened a new log
I20260812 00:07:35.853803 2744 ts_tablet_manager.cc:1397] T cc7b12e4f3d94b84b67ff14adb05dc82 P 054db65d304b40cdb7883f9e7bd402c0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:07:35.853929 2741 tablet_bootstrap.cc:492] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70: Bootstrap starting.
I20260812 00:07:35.854485 2741 tablet_bootstrap.cc:654] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70: Neither blocks nor log segments found. Creating new log.
I20260812 00:07:35.854803 2741 log.cc:824] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:35.856043 2744 raft_consensus.cc:348] T cc7b12e4f3d94b84b67ff14adb05dc82 P 054db65d304b40cdb7883f9e7bd402c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de36c942fc63421a90f8b8958f8223f9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 44765 } } peers { permanent_uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36985 } } peers { permanent_uuid: "054db65d304b40cdb7883f9e7bd402c0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 40981 } }
I20260812 00:07:35.856197 2744 raft_consensus.cc:374] T cc7b12e4f3d94b84b67ff14adb05dc82 P 054db65d304b40cdb7883f9e7bd402c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:07:35.856258 2744 raft_consensus.cc:729] T cc7b12e4f3d94b84b67ff14adb05dc82 P 054db65d304b40cdb7883f9e7bd402c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054db65d304b40cdb7883f9e7bd402c0, State: Initialized, Role: FOLLOWER
I20260812 00:07:35.856383 2744 consensus_queue.cc:260] T cc7b12e4f3d94b84b67ff14adb05dc82 P 054db65d304b40cdb7883f9e7bd402c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de36c942fc63421a90f8b8958f8223f9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 44765 } } peers { permanent_uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36985 } } peers { permanent_uuid: "054db65d304b40cdb7883f9e7bd402c0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 40981 } }
I20260812 00:07:35.856669 2406 heartbeater.cc:503] Master 127.19.59.126:45775 was elected leader, sending a full tablet report...
I20260812 00:07:35.856667 2744 ts_tablet_manager.cc:1428] T cc7b12e4f3d94b84b67ff14adb05dc82 P 054db65d304b40cdb7883f9e7bd402c0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:07:35.858146 2741 tablet_bootstrap.cc:492] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70: No bootstrap required, opened a new log
I20260812 00:07:35.858242 2741 ts_tablet_manager.cc:1397] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 00:07:35.859938 2741 raft_consensus.cc:348] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de36c942fc63421a90f8b8958f8223f9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 44765 } } peers { permanent_uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36985 } } peers { permanent_uuid: "054db65d304b40cdb7883f9e7bd402c0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 40981 } }
I20260812 00:07:35.860080 2741 raft_consensus.cc:374] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:07:35.860162 2741 raft_consensus.cc:729] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c28b9d6e2f4f0cb70d7b92450bfa70, State: Initialized, Role: FOLLOWER
I20260812 00:07:35.860301 2741 consensus_queue.cc:260] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de36c942fc63421a90f8b8958f8223f9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 44765 } } peers { permanent_uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36985 } } peers { permanent_uuid: "054db65d304b40cdb7883f9e7bd402c0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 40981 } }
I20260812 00:07:35.860577 2741 ts_tablet_manager.cc:1428] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:07:35.860585 2693 heartbeater.cc:503] Master 127.19.59.126:45775 was elected leader, sending a full tablet report...
I20260812 00:07:35.860658 2740 tablet_bootstrap.cc:492] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9: No bootstrap required, opened a new log
I20260812 00:07:35.860713 2740 ts_tablet_manager.cc:1397] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20260812 00:07:35.863093 2740 raft_consensus.cc:348] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de36c942fc63421a90f8b8958f8223f9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 44765 } } peers { permanent_uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36985 } } peers { permanent_uuid: "054db65d304b40cdb7883f9e7bd402c0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 40981 } }
I20260812 00:07:35.863240 2740 raft_consensus.cc:374] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:07:35.863270 2740 raft_consensus.cc:729] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de36c942fc63421a90f8b8958f8223f9, State: Initialized, Role: FOLLOWER
I20260812 00:07:35.863372 2740 consensus_queue.cc:260] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de36c942fc63421a90f8b8958f8223f9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 44765 } } peers { permanent_uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36985 } } peers { permanent_uuid: "054db65d304b40cdb7883f9e7bd402c0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 40981 } }
I20260812 00:07:35.863605 2740 ts_tablet_manager.cc:1428] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:07:35.863682 2550 heartbeater.cc:503] Master 127.19.59.126:45775 was elected leader, sending a full tablet report...
W20260812 00:07:35.889389 2551 tablet.cc:2369] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 00:07:35 dist-test-slave-6nmv krb5kdc[1005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493255, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for HTTP/127.19.59.84@KRBTEST.COM
W20260812 00:07:35.959182 2407 tablet.cc:2369] T cc7b12e4f3d94b84b67ff14adb05dc82 P 054db65d304b40cdb7883f9e7bd402c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:07:36.008178 2750 raft_consensus.cc:482] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:07:36.008335 2750 raft_consensus.cc:504] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de36c942fc63421a90f8b8958f8223f9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 44765 } } peers { permanent_uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36985 } } peers { permanent_uuid: "054db65d304b40cdb7883f9e7bd402c0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 40981 } }
I20260812 00:07:36.008750 2750 leader_election.cc:288] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c28b9d6e2f4f0cb70d7b92450bfa70 (127.19.59.67:36985), 054db65d304b40cdb7883f9e7bd402c0 (127.19.59.65:40981)
I20260812 00:07:36.015137 2738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:36.009137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:47029 (local address 127.19.59.65:40981)
0812 00:07:36.009174 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:36.009176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:36.011864 (+ 2688us) server_negotiation.cc:407] Connection header received
0812 00:07:36.011958 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:36.011959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:36.011968 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:36.011996 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:07:36.012220 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:36.012933 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:36.014223 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:36.014745 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:36.014793 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:36.014801 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:36.015028 (+ 227us) server_negotiation.cc:299] Negotiation successful
0812 00:07:36.015065 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:07:36.015574 2753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:36.008931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:40981 (local address 127.19.59.66:47029)
0812 00:07:36.011815 (+ 2884us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:36.011823 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:36.011886 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:36.012072 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:36.012073 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:36.012074 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:07:36.012153 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:36.012155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:36.013020 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:36.013021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:36.014131 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:36.014134 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:36.014881 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:36.014882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:36.014950 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:36.014954 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:07:36.015432 (+ 478us) client_negotiation.cc:240] Negotiation successful
0812 00:07:36.015475 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2870,"thread_start_us":93,"threads_started":1}
I20260812 00:07:36.016038 2355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7b12e4f3d94b84b67ff14adb05dc82" candidate_uuid: "de36c942fc63421a90f8b8958f8223f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054db65d304b40cdb7883f9e7bd402c0" is_pre_election: true
I20260812 00:07:36.016187 2355 raft_consensus.cc:2454] T cc7b12e4f3d94b84b67ff14adb05dc82 P 054db65d304b40cdb7883f9e7bd402c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de36c942fc63421a90f8b8958f8223f9 in term 0.
I20260812 00:07:36.016402 2431 leader_election.cc:302] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054db65d304b40cdb7883f9e7bd402c0, de36c942fc63421a90f8b8958f8223f9; no voters:
I20260812 00:07:36.016508 2750 raft_consensus.cc:2781] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:07:36.016556 2750 raft_consensus.cc:482] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:07:36.016574 2750 raft_consensus.cc:3037] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:07:36.017431 2750 raft_consensus.cc:504] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de36c942fc63421a90f8b8958f8223f9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 44765 } } peers { permanent_uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36985 } } peers { permanent_uuid: "054db65d304b40cdb7883f9e7bd402c0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 40981 } }
I20260812 00:07:36.017545 2750 leader_election.cc:288] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [CANDIDATE]: Term 1 election: Requested vote from peers 20c28b9d6e2f4f0cb70d7b92450bfa70 (127.19.59.67:36985), 054db65d304b40cdb7883f9e7bd402c0 (127.19.59.65:40981)
I20260812 00:07:36.017972 2355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7b12e4f3d94b84b67ff14adb05dc82" candidate_uuid: "de36c942fc63421a90f8b8958f8223f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054db65d304b40cdb7883f9e7bd402c0"
I20260812 00:07:36.018057 2355 raft_consensus.cc:3037] T cc7b12e4f3d94b84b67ff14adb05dc82 P 054db65d304b40cdb7883f9e7bd402c0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:07:36.018965 2355 raft_consensus.cc:2454] T cc7b12e4f3d94b84b67ff14adb05dc82 P 054db65d304b40cdb7883f9e7bd402c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de36c942fc63421a90f8b8958f8223f9 in term 1.
I20260812 00:07:36.019161 2431 leader_election.cc:302] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054db65d304b40cdb7883f9e7bd402c0, de36c942fc63421a90f8b8958f8223f9; no voters:
I20260812 00:07:36.019264 2750 raft_consensus.cc:2781] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:07:36.019398 2750 raft_consensus.cc:686] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [term 1 LEADER]: Becoming Leader. State: Replica: de36c942fc63421a90f8b8958f8223f9, State: Running, Role: LEADER
I20260812 00:07:36.019470 2750 consensus_queue.cc:237] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de36c942fc63421a90f8b8958f8223f9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 44765 } } peers { permanent_uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36985 } } peers { permanent_uuid: "054db65d304b40cdb7883f9e7bd402c0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 40981 } }
I20260812 00:07:36.020255 2185 catalog_manager.cc:5495] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to de36c942fc63421a90f8b8958f8223f9 (127.19.59.66). New cstate: current_term: 1 leader_uuid: "de36c942fc63421a90f8b8958f8223f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de36c942fc63421a90f8b8958f8223f9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 44765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054db65d304b40cdb7883f9e7bd402c0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 40981 } health_report { overall_health: UNKNOWN } } }
I20260812 00:07:36.021950 2754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:36.008904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:36985 (local address 127.19.59.66:44371)
0812 00:07:36.011642 (+ 2738us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:36.011655 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:36.011728 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:36.015505 (+ 3777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:36.015506 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:36.015509 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:07:36.015570 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:36.015571 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:36.017161 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:36.017161 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:36.018161 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:36.018163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:36.021698 (+ 3535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:36.021698 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:36.021761 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:36.021765 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:07:36.021844 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 00:07:36.021878 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2716,"thread_start_us":92,"threads_started":1}
I20260812 00:07:36.021970 2733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:36.009112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:44371 (local address 127.19.59.67:36985)
0812 00:07:36.009153 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:36.009155 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:36.011718 (+ 2563us) server_negotiation.cc:407] Connection header received
0812 00:07:36.013950 (+ 2232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:36.013951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:36.013961 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:36.014017 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:07:36.016362 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:36.017052 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:36.021091 (+ 4039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:36.021588 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:36.021634 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:36.021643 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:36.021865 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 00:07:36.021910 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:07:36.022480 2626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7b12e4f3d94b84b67ff14adb05dc82" candidate_uuid: "de36c942fc63421a90f8b8958f8223f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70" is_pre_election: true
I20260812 00:07:36.022617 2626 raft_consensus.cc:2454] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de36c942fc63421a90f8b8958f8223f9 in term 0.
I20260812 00:07:36.022712 2627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7b12e4f3d94b84b67ff14adb05dc82" candidate_uuid: "de36c942fc63421a90f8b8958f8223f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70"
I20260812 00:07:36.022755 2627 raft_consensus.cc:3037] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:07:36.023465 2627 raft_consensus.cc:2454] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de36c942fc63421a90f8b8958f8223f9 in term 1.
W20260812 00:07:36.045758 2695 tablet.cc:2369] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:07:36.065256 2734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:36.062190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48320 (local address 127.19.59.66:44765)
0812 00:07:36.062233 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:36.062234 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:36.062241 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:07:36.062277 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:36.062277 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:36.062295 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:36.062351 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:07:36.062526 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:36.063191 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:36.064180 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:36.064432 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:36.064488 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:36.064718 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:07:36.064845 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:07:36.064921 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:36.065156 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 00:07:36.065178 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:07:36.067575 2355 raft_consensus.cc:1261] T cc7b12e4f3d94b84b67ff14adb05dc82 P 054db65d304b40cdb7883f9e7bd402c0 [term 1 FOLLOWER]: Refusing update from remote peer de36c942fc63421a90f8b8958f8223f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:07:36.068003 2755 consensus_queue.cc:1035] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "054db65d304b40cdb7883f9e7bd402c0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:07:36.070062 2627 raft_consensus.cc:1261] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70 [term 1 FOLLOWER]: Refusing update from remote peer de36c942fc63421a90f8b8958f8223f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:07:36.070340 2755 consensus_queue.cc:1035] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c28b9d6e2f4f0cb70d7b92450bfa70" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:07:36.074110 2764 mvcc.cc:205] Tried to move back new op lower bound from 7317476376849641472 to 7317476376656240640. Current Snapshot: MvccSnapshot[applied={T|T < 7317476376849641472}]
I20260812 00:07:36.074316 2768 mvcc.cc:205] Tried to move back new op lower bound from 7317476376849641472 to 7317476376656240640. Current Snapshot: MvccSnapshot[applied={T|T < 7317476376849641472}]
I20260812 00:07:36.079005 2185 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:07:36.079094 2185 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:07:36.079839 2185 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cd2b24341fea47158be371f38bd4124f: Sending DeleteTablet for 3 replicas of tablet cc7b12e4f3d94b84b67ff14adb05dc82
I20260812 00:07:36.080179 2316 tablet_service.cc:1514] Processing DeleteTablet for tablet cc7b12e4f3d94b84b67ff14adb05dc82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:07:36 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:60720
I20260812 00:07:36.080420 2481 tablet_service.cc:1514] Processing DeleteTablet for tablet cc7b12e4f3d94b84b67ff14adb05dc82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:07:36 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:48316
I20260812 00:07:36.080892 2603 tablet_service.cc:1514] Processing DeleteTablet for tablet cc7b12e4f3d94b84b67ff14adb05dc82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:07:36 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:46882
I20260812 00:07:36.081367 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 2229
I20260812 00:07:36.089766 2774 tablet_replica.cc:330] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9: stopping tablet replica
I20260812 00:07:36.089919 2775 tablet_replica.cc:330] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70: stopping tablet replica
I20260812 00:07:36.090092 2775 raft_consensus.cc:2229] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:07:36.090221 2774 raft_consensus.cc:2229] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:07:36.090365 2775 raft_consensus.cc:2258] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:07:36.090529 2774 raft_consensus.cc:2258] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:07:36.091342 2774 ts_tablet_manager.cc:1905] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:07:36.102133 2775 ts_tablet_manager.cc:1905] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:07:36.102785 2774 ts_tablet_manager.cc:1918] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:07:36.102851 2774 log.cc:1196] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/cc7b12e4f3d94b84b67ff14adb05dc82
I20260812 00:07:36.103127 2774 ts_tablet_manager.cc:1939] T cc7b12e4f3d94b84b67ff14adb05dc82 P de36c942fc63421a90f8b8958f8223f9: Deleting consensus metadata
I20260812 00:07:36.103610 2168 catalog_manager.cc:4841] TS de36c942fc63421a90f8b8958f8223f9 (127.19.59.66:44765): tablet cc7b12e4f3d94b84b67ff14adb05dc82 (table test-table [id=7aaed26ab2774325b7761bbf7d69b27d]) successfully deleted
I20260812 00:07:36.103763 2775 ts_tablet_manager.cc:1918] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:07:36.103839 2775 log.cc:1196] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/cc7b12e4f3d94b84b67ff14adb05dc82
W20260812 00:07:36.103924 2168 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:40981 (error 108)
I20260812 00:07:36.104128 2775 ts_tablet_manager.cc:1939] T cc7b12e4f3d94b84b67ff14adb05dc82 P 20c28b9d6e2f4f0cb70d7b92450bfa70: Deleting consensus metadata
I20260812 00:07:36.104553 2166 catalog_manager.cc:4841] TS 20c28b9d6e2f4f0cb70d7b92450bfa70 (127.19.59.67:36985): tablet cc7b12e4f3d94b84b67ff14adb05dc82 (table test-table [id=7aaed26ab2774325b7761bbf7d69b27d]) successfully deleted
I20260812 00:07:36.105021 2728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:36.104892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:40981 (local address 127.0.0.1:60726)
0812 00:07:36.104938 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:36.104969 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:40981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 00:07:36.105172 2168 catalog_manager.cc:4584] TS 054db65d304b40cdb7883f9e7bd402c0 (127.19.59.65:40981): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cc7b12e4f3d94b84b67ff14adb05dc82: Network error: Client connection negotiation failed: client connection to 127.19.59.65:40981: connect: Connection refused (error 111)
I20260812 00:07:36.105446 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 2408
I20260812 00:07:36.127110 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 2552
I20260812 00:07:36.153333 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 2142
I20260812 00:07:36.162891 19693 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 00:07:36.506937 19693 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 00:07:36.507046 19693 mini_ranger.cc:66] Stopping Ranger...
I20260812 00:07:36.852134 19693 mini_ranger.cc:68] Stopped Ranger
2026-08-12 00:07:36.852 UTC [1041] LOG: received smart shutdown request
2026-08-12 00:07:36.856 UTC [1041] LOG: background worker "logical replication launcher" (PID 1051) exited with exit code 1
2026-08-12 00:07:36.856 UTC [1045] LOG: shutting down
2026-08-12 00:07:36.999 UTC [1041] LOG: database system is shut down
2026-08-12T00:07:37Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47046 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:07:37 dist-test-slave-6nmv krb5kdc[2786](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:07:37 dist-test-slave-6nmv krb5kdc[2786](info): set up 2 sockets
Aug 12 00:07:37 dist-test-slave-6nmv krb5kdc[2786](info): commencing operation
krb5kdc: starting...
W20260812 00:07:38.122094 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.002s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:07:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:07:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:07:38.230734 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:34149
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:34149,127.19.59.125:35499,127.19.59.124:37553
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:07:38.302467 2800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:38.302671 2800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:38.302704 2800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:38.303705 2800 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:07:38.303771 2800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:38.303791 2800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:38.303809 2800 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:07:38.303834 2800 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:07:38.305259 2800 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:34149,127.19.59.125:35499,127.19.59.124:37553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:34149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:38.305537 2800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:38.305757 2800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:38.310395 2809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:38.310499 2800 server_base.cc:1034] running on GCE node
W20260812 00:07:38.310388 2807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:38.310392 2806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:38.310871 2800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:38.311136 2800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:38.312273 2800 hybrid_clock.cc:648] HybridClock initialized: now 1786493258312264 us; error 30 us; skew 500 ppm
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:38.314620 2800 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:07:38.315068 2800 webserver.cc:460] Webserver started at http://127.19.59.126:38289/ using document root <none> and password file <none>
I20260812 00:07:38.315289 2800 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:38.315356 2800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:38.315510 2800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:07:38.316453 2800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "15f0d62292394cbe990dd9f935394a0a"
format_stamp: "Formatted at 2026-08-12 00:07:38 on dist-test-slave-6nmv"
server_key: "f25c47c247f2b10ce045d98767d90fa0"
server_key_iv: "844b7404676afb9a51b323f547f05f84"
server_key_version: "encryptionkey@0"
I20260812 00:07:38.316772 2800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "15f0d62292394cbe990dd9f935394a0a"
format_stamp: "Formatted at 2026-08-12 00:07:38 on dist-test-slave-6nmv"
server_key: "f25c47c247f2b10ce045d98767d90fa0"
server_key_iv: "844b7404676afb9a51b323f547f05f84"
server_key_version: "encryptionkey@0"
I20260812 00:07:38.318017 2800 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:07:38.318708 2816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:38.318863 2800 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:07:38.318960 2800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "15f0d62292394cbe990dd9f935394a0a"
format_stamp: "Formatted at 2026-08-12 00:07:38 on dist-test-slave-6nmv"
server_key: "f25c47c247f2b10ce045d98767d90fa0"
server_key_iv: "844b7404676afb9a51b323f547f05f84"
server_key_version: "encryptionkey@0"
I20260812 00:07:38.319036 2800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:38.331946 2800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:38.333513 2800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:38.333649 2800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:38.337354 2800 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:34149
I20260812 00:07:38.337383 2877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:34149 every 8 connection(s)
I20260812 00:07:38.337677 2800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:07:38.338451 2878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:07:38.339702 2878 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:38.344992 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 2800
I20260812 00:07:38.345078 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:07:38.345291 19693 external_mini_cluster.cc:1428] Setting key d8766de86dd89b26ca6ff3ad4df3258a
I20260812 00:07:38.347898 2881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.340238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:34149 (local address 127.0.0.1:41688)
0812 00:07:38.340369 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.340398 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:38.340772 (+ 374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:38.340998 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:38.341000 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:38.341207 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:38.341332 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.341335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.342219 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.342219 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.342781 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.342782 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.343171 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.343172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.343220 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.343602 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:38.343609 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:38.344804 (+ 1195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:38.346571 (+ 1767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.346578 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.346580 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.346834 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.347090 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.347090 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.347091 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.347174 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.347549 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:38.347553 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:38.347600 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 00:07:38.347659 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 00:07:38.347764 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
I20260812 00:07:38.347988 2882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.340369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41688 (local address 127.19.59.126:34149)
0812 00:07:38.340476 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:38.340482 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:38.340510 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:07:38.340880 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:38.340882 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:38.340896 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:38.340962 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:38.341401 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.342149 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.342842 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.343107 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.343178 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.344904 (+ 1726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:38.344910 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:38.344911 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:38.344917 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:38.346496 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.346920 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.346923 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.346923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.347023 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.347232 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.347234 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.347234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.347487 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:38.347562 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:38.347710 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 00:07:38.347847 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":81,"thread_start_us":57,"threads_started":1}
I20260812 00:07:38.348603 2878 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:07:38.348927 2881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.348805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:35499 (local address 127.0.0.1:47706)
0812 00:07:38.348852 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.348901 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 00:07:38.349115 2817 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.59.125:35499: connect: Connection refused (error 111)
I20260812 00:07:38.349555 2881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.349425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:35499 (local address 127.0.0.1:47714)
0812 00:07:38.349491 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.349524 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 00:07:38.349671 2878 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.125:35499: Network error: Client connection negotiation failed: client connection to 127.19.59.125:35499: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.19.59.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.125.keytab.
Entry for principal kudu/127.19.59.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.125.keytab.
I20260812 00:07:38.368673 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.125:35499
--webserver_interface=127.19.59.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.125.keytab
--principal=kudu/127.19.59.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:34149,127.19.59.125:35499,127.19.59.124:37553
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:07:38.398888 2878 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } attempt: 1
I20260812 00:07:38.399346 2881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.399199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:35499 (local address 127.0.0.1:47718)
0812 00:07:38.399264 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.399309 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 00:07:38.399720 2881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.399623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:35499 (local address 127.0.0.1:47734)
0812 00:07:38.399673 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.399699 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 00:07:38.399844 2878 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.125:35499: Network error: Client connection negotiation failed: client connection to 127.19.59.125:35499: connect: Connection refused (error 111)
W20260812 00:07:38.442147 2886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:38.442361 2886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:38.442382 2886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:38.443312 2886 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:07:38.443363 2886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:38.443375 2886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:38.443387 2886 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:07:38.443397 2886 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:07:38.444644 2886 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:34149,127.19.59.125:35499,127.19.59.124:37553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.125.keytab
--principal=kudu/127.19.59.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.125:35499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.59.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:38.444814 2886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:38.445006 2886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:38.449303 2893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:38.449285 2896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:38.449301 2894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:38.449604 2886 server_base.cc:1034] running on GCE node
I20260812 00:07:38.449896 2886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:38.450156 2886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:38.451303 2886 hybrid_clock.cc:648] HybridClock initialized: now 1786493258451293 us; error 26 us; skew 500 ppm
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:38.453558 2886 init.cc:377] Logged in from keytab as kudu/127.19.59.125@KRBTEST.COM (short username kudu)
I20260812 00:07:38.453987 2886 webserver.cc:460] Webserver started at http://127.19.59.125:42347/ using document root <none> and password file <none>
I20260812 00:07:38.454191 2886 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:38.454250 2886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:38.454370 2886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:07:38.455329 2886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/data/instance:
uuid: "ccbcd328e6ec43719cbf7860303797aa"
format_stamp: "Formatted at 2026-08-12 00:07:38 on dist-test-slave-6nmv"
server_key: "7968ed7904d1f53ec8a85d977b613ae3"
server_key_iv: "643afb179169277f174cc8247a30b386"
server_key_version: "encryptionkey@0"
I20260812 00:07:38.455679 2886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/wal/instance:
uuid: "ccbcd328e6ec43719cbf7860303797aa"
format_stamp: "Formatted at 2026-08-12 00:07:38 on dist-test-slave-6nmv"
server_key: "7968ed7904d1f53ec8a85d977b613ae3"
server_key_iv: "643afb179169277f174cc8247a30b386"
server_key_version: "encryptionkey@0"
I20260812 00:07:38.456852 2886 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:07:38.457511 2903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:38.457696 2886 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:38.457775 2886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/wal
uuid: "ccbcd328e6ec43719cbf7860303797aa"
format_stamp: "Formatted at 2026-08-12 00:07:38 on dist-test-slave-6nmv"
server_key: "7968ed7904d1f53ec8a85d977b613ae3"
server_key_iv: "643afb179169277f174cc8247a30b386"
server_key_version: "encryptionkey@0"
I20260812 00:07:38.457870 2886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:38.468163 2878 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } attempt: 2
I20260812 00:07:38.468526 2881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.468406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:35499 (local address 127.0.0.1:47742)
0812 00:07:38.468471 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.468503 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 00:07:38.468906 2881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.468806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:35499 (local address 127.0.0.1:47744)
0812 00:07:38.468842 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.468882 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260812 00:07:38.469002 2878 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.125:35499: Network error: Client connection negotiation failed: client connection to 127.19.59.125:35499: connect: Connection refused (error 111)
I20260812 00:07:38.479233 2886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:38.480882 2886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:38.480984 2886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:38.484778 2886 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.125:35499
I20260812 00:07:38.484810 2963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.125:35499 every 8 connection(s)
I20260812 00:07:38.485227 2886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/data/info.pb
I20260812 00:07:38.486140 2964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:07:38.487591 2964 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:07:38.492986 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 2886
I20260812 00:07:38.493088 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-1/wal/instance
I20260812 00:07:38.493291 19693 external_mini_cluster.cc:1428] Setting key 5342c7532efbdf14e28277bd514b10c9
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.125@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:38.497027 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.488279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:34149 (local address 127.0.0.1:41690)
0812 00:07:38.488471 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.488504 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:38.488978 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:38.489255 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:38.489258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:38.489490 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:38.489660 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.489664 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.490390 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.490391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.491278 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.491281 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.491690 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.491691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.491818 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.492297 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:38.492305 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:38.493965 (+ 1660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:38.495659 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.495666 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.495668 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.496006 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.496195 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.496196 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.496196 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.496310 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.496584 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:38.496588 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:38.496700 (+ 112us) client_negotiation.cc:769] Sending connection context
0812 00:07:38.496775 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:07:38.496878 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":87,"threads_started":1}
I20260812 00:07:38.497042 2882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.488312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41690 (local address 127.19.59.126:34149)
0812 00:07:38.488369 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:38.488370 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:38.488581 (+ 211us) server_negotiation.cc:407] Connection header received
0812 00:07:38.489094 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:38.489095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:38.489121 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:38.489186 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:38.489756 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.490275 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.491371 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.491580 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.491680 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.494050 (+ 2370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:38.494051 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:38.494051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:38.494057 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:38.495575 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.496090 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.496091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.496091 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.496141 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.496386 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.496387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.496387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.496522 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:38.496586 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:38.496821 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 00:07:38.496913 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:07:38.497519 2964 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.125@KRBTEST.COM for kudu/127.19.59.125@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.59.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.124@KRBTEST.COM" created.
I20260812 00:07:38.504313 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.497763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:35499 (local address 127.0.0.1:47754)
0812 00:07:38.497999 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.498009 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:38.498059 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:38.498186 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:38.498187 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:38.498317 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:38.498371 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.498373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.499043 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.499044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.499783 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.499785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.500165 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.500166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.500239 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.500544 (+ 305us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:38.500549 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:38.501649 (+ 1100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:38.503390 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.503391 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.503391 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.503540 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.503741 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.503742 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.503742 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.503795 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.504023 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:38.504024 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:38.504054 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 00:07:38.504095 (+ 41us) client_negotiation.cc:240] Negotiation successful
0812 00:07:38.504168 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222}
I20260812 00:07:38.504328 2968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.497853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47754 (local address 127.19.59.125:35499)
0812 00:07:38.498021 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:38.498024 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:38.498053 (+ 29us) server_negotiation.cc:407] Connection header received
0812 00:07:38.498117 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:38.498118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:38.498128 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:38.498180 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:38.498431 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.498963 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.499857 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.500092 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.500141 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.501725 (+ 1584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:38.501731 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:38.501732 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:38.501737 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:38.503298 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.503622 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.503624 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.503624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.503675 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.503851 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.503852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.503852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.503971 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:38.504025 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:38.504143 (+ 118us) server_negotiation.cc:299] Negotiation successful
0812 00:07:38.504223 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":140,"thread_start_us":83,"threads_started":1}
I20260812 00:07:38.504921 2964 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:07:38.505262 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.505133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:37553 (local address 127.0.0.1:59214)
0812 00:07:38.505182 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.505230 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 00:07:38.505412 2908 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
I20260812 00:07:38.505910 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.505772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:37553 (local address 127.0.0.1:59222)
0812 00:07:38.505846 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.505880 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 00:07:38.506096 2964 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.124:37553: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.124.keytab.
Entry for principal kudu/127.19.59.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.124.keytab.
I20260812 00:07:38.516430 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.124:37553
--webserver_interface=127.19.59.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.124.keytab
--principal=kudu/127.19.59.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:34149,127.19.59.125:35499,127.19.59.124:37553
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:07:38.555346 2964 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } attempt: 1
I20260812 00:07:38.555887 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.555737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:37553 (local address 127.0.0.1:59234)
0812 00:07:38.555803 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.555848 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 00:07:38.556272 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.556174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:37553 (local address 127.0.0.1:59240)
0812 00:07:38.556221 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.556248 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 00:07:38.556352 2964 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.124:37553: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
I20260812 00:07:38.560125 2878 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } attempt: 3
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for kudu/127.19.59.125@KRBTEST.COM
I20260812 00:07:38.567206 2881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.560408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:35499 (local address 127.0.0.1:47768)
0812 00:07:38.560451 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.560473 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:38.560547 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:38.560723 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:38.560724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:38.560892 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:38.560958 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.560961 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.561621 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.561622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.562143 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.562146 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.562528 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.562529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.562611 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.563078 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:38.563085 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:38.564281 (+ 1196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:38.566185 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.566186 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.566187 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.566352 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.566567 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.566568 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.566568 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.566627 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.566891 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:38.566892 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:38.566936 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 00:07:38.567019 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 00:07:38.567122 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 00:07:38.567203 2968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.560466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47768 (local address 127.19.59.125:35499)
0812 00:07:38.560523 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:38.560525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:38.560535 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:07:38.560639 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:38.560640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:38.560652 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:38.560715 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:38.561062 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.561531 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.562238 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.562443 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.562526 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.564404 (+ 1878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:38.564406 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:38.564406 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:38.564413 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:38.566092 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.566441 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.566442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.566443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.566502 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.566701 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.566702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.566702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.566810 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:38.566897 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:38.567043 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 00:07:38.567122 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:07:38.567538 2878 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:07:38.567886 2881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.567784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:37553 (local address 127.0.0.1:59244)
0812 00:07:38.567829 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.567855 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:07:38.568297 2881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.568214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:37553 (local address 127.0.0.1:59248)
0812 00:07:38.568254 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.568277 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 00:07:38.568418 2878 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.124:37553: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
W20260812 00:07:38.591758 2971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:38.591950 2971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:38.591972 2971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:38.593115 2971 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:07:38.593154 2971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:38.593168 2971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:38.593178 2971 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:07:38.593189 2971 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:07:38.594762 2971 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:34149,127.19.59.125:35499,127.19.59.124:37553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.124.keytab
--principal=kudu/127.19.59.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.124:37553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.59.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:38.595038 2971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:38.595265 2971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:07:38.599556 2878 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } attempt: 1
W20260812 00:07:38.599969 2977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:38.600068 2980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:38.600080 2976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:38.600497 2971 server_base.cc:1034] running on GCE node
I20260812 00:07:38.600580 2881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.599853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:37553 (local address 127.0.0.1:59250)
0812 00:07:38.599907 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.600531 (+ 624us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 00:07:38.600765 2971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:38.601023 2881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.600894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:37553 (local address 127.0.0.1:59252)
0812 00:07:38.600949 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.600980 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 00:07:38.601083 2971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
W20260812 00:07:38.601171 2878 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.124:37553: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
I20260812 00:07:38.602232 2971 hybrid_clock.cc:648] HybridClock initialized: now 1786493258602201 us; error 39 us; skew 500 ppm
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:38.604946 2971 init.cc:377] Logged in from keytab as kudu/127.19.59.124@KRBTEST.COM (short username kudu)
I20260812 00:07:38.605433 2971 webserver.cc:460] Webserver started at http://127.19.59.124:39419/ using document root <none> and password file <none>
I20260812 00:07:38.605784 2971 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:38.605885 2971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:38.606034 2971 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:07:38.607337 2971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/data/instance:
uuid: "a504ff995a11446a9054a1d0ec82375d"
format_stamp: "Formatted at 2026-08-12 00:07:38 on dist-test-slave-6nmv"
server_key: "12a538b53b2d1eb6dca0f3fea9accdf3"
server_key_iv: "8340cb3118f866e632363922d3e3be98"
server_key_version: "encryptionkey@0"
I20260812 00:07:38.607786 2971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/wal/instance:
uuid: "a504ff995a11446a9054a1d0ec82375d"
format_stamp: "Formatted at 2026-08-12 00:07:38 on dist-test-slave-6nmv"
server_key: "12a538b53b2d1eb6dca0f3fea9accdf3"
server_key_iv: "8340cb3118f866e632363922d3e3be98"
server_key_version: "encryptionkey@0"
I20260812 00:07:38.609556 2971 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 00:07:38.610299 2987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:38.610574 2971 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:07:38.610678 2971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/wal
uuid: "a504ff995a11446a9054a1d0ec82375d"
format_stamp: "Formatted at 2026-08-12 00:07:38 on dist-test-slave-6nmv"
server_key: "12a538b53b2d1eb6dca0f3fea9accdf3"
server_key_iv: "8340cb3118f866e632363922d3e3be98"
server_key_version: "encryptionkey@0"
I20260812 00:07:38.610752 2971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:38.624230 2971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:38.624828 2964 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } attempt: 2
I20260812 00:07:38.626206 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.626052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:37553 (local address 127.0.0.1:59256)
0812 00:07:38.626124 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.626168 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 00:07:38.627041 2971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:38.627094 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.626984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:37553 (local address 127.0.0.1:59272)
0812 00:07:38.627035 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.627065 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 00:07:38.627164 2971 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260812 00:07:38.627264 2964 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.124:37553: Network error: Client connection negotiation failed: client connection to 127.19.59.124:37553: connect: Connection refused (error 111)
I20260812 00:07:38.632019 2971 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.124:37553
I20260812 00:07:38.632061 3049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.124:37553 every 8 connection(s)
I20260812 00:07:38.632477 2971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/data/info.pb
I20260812 00:07:38.633332 3050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:07:38.634960 3050 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.124@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:38.640990 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 2971
I20260812 00:07:38.641100 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786493109864389-19693-0/minicluster-data/master-2/wal/instance
I20260812 00:07:38.641312 19693 external_mini_cluster.cc:1428] Setting key 388f129f1107349cf68ad9d48386e7d9
I20260812 00:07:38.643988 2882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.635710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41696 (local address 127.19.59.126:34149)
0812 00:07:38.635767 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:38.635769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:38.636020 (+ 251us) server_negotiation.cc:407] Connection header received
0812 00:07:38.636497 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:38.636499 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:38.636511 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:38.636560 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:38.637183 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.637654 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.638661 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.638855 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.638940 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.641015 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:38.641017 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:38.641018 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:38.641024 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:38.642590 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.642969 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.642971 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.642971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.643036 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.643277 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.643278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.643278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.643424 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:38.643493 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:38.643746 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 00:07:38.643856 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:07:38.644165 3052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.635696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:34149 (local address 127.0.0.1:41696)
0812 00:07:38.635880 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.635913 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:38.636388 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:38.636622 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:38.636625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:38.636860 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:38.637085 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.637090 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.637747 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.637748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.638560 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.638562 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.638954 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.638955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.639075 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.639643 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:38.639651 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:38.640922 (+ 1271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:38.642680 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.642687 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.642689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.642879 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.643093 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.643094 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.643094 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.643208 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.643490 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:38.643494 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:38.643615 (+ 121us) client_negotiation.cc:769] Sending connection context
0812 00:07:38.643706 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 00:07:38.643858 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":104,"threads_started":1}
I20260812 00:07:38.644695 3050 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.124@KRBTEST.COM
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.124@KRBTEST.COM for kudu/127.19.59.125@KRBTEST.COM
I20260812 00:07:38.651285 3054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.641695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59274 (local address 127.19.59.124:37553)
0812 00:07:38.641876 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:38.641881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:38.642045 (+ 164us) server_negotiation.cc:407] Connection header received
0812 00:07:38.642071 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:38.642073 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:38.642087 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:38.642149 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:38.642933 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.643772 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.644718 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.645249 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.645329 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.647948 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:38.647955 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:38.647955 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:38.647961 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:38.650100 (+ 2139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.650408 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.650410 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.650411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.650471 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.650675 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.650677 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.650677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.650829 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:38.650946 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:38.651124 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 00:07:38.651190 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":71,"threads_started":1}
I20260812 00:07:38.652894 3052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.644939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:35499 (local address 127.0.0.1:47778)
0812 00:07:38.644984 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.644993 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:38.645027 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:38.645150 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:38.645151 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:38.645279 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:38.645352 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.645354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.646564 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.646565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.647082 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.647084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.647401 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.647402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.647465 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.647843 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:38.647847 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:38.649365 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:38.652013 (+ 2648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.652014 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.652014 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.652204 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.652370 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.652370 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.652371 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.652419 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.652645 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:38.652646 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:38.652681 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 00:07:38.652742 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 00:07:38.652821 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 00:07:38.652915 2968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.644989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47778 (local address 127.19.59.125:35499)
0812 00:07:38.645031 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:38.645032 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:38.645041 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:07:38.645085 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:38.645086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:38.645094 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:38.645138 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:38.645449 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.646464 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.647160 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.647338 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.647404 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.649494 (+ 2090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:38.649495 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:38.649495 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:38.649502 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:38.651922 (+ 2420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.652252 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.652253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.652254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.652302 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.652484 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.652485 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.652485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.652585 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:38.652652 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:38.652780 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 00:07:38.652839 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:07:38.653136 3050 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.124@KRBTEST.COM for kudu/127.19.59.124@KRBTEST.COM
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:38.659793 3052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.653350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:37553 (local address 127.0.0.1:59276)
0812 00:07:38.653383 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.653391 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:38.653423 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:38.653516 (+ 93us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:38.653517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:38.653626 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:38.653645 (+ 19us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.653646 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.654223 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.654224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.654606 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.654607 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.654985 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.654986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.655056 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.655562 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:38.655568 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:38.656914 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:38.658835 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.658836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.658836 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.659016 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.659206 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.659207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.659207 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.659263 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.659500 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:38.659501 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:38.659538 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:07:38.659599 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 00:07:38.659676 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 00:07:38.660066 2882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.652058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41712 (local address 127.19.59.126:34149)
0812 00:07:38.652094 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:38.652096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:38.652132 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:07:38.652200 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:38.652202 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:38.652211 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:38.652254 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:38.652848 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.653548 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.654929 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.655160 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.655233 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.657554 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:38.657555 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:38.657555 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:38.657562 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:38.658899 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.659255 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.659256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.659256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.659299 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.659480 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.659481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.659481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.659587 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:38.659738 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:38.659925 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 00:07:38.659992 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:07:38.660097 3054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.653379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59276 (local address 127.19.59.124:37553)
0812 00:07:38.653404 (+ 25us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:38.653406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:38.653412 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:07:38.653463 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:38.653463 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:38.653471 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:38.653507 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:38.653712 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.654156 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.654685 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.654921 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.654983 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.657009 (+ 2026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:38.657010 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:38.657011 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:38.657018 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:38.658750 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.659082 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.659083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.659083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.659140 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.659323 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.659324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.659324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.659447 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:38.659508 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:38.659637 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 00:07:38.659729 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":13,"server-negotiator.queue_time_us":15}
I20260812 00:07:38.661571 3050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d: Bootstrap starting.
I20260812 00:07:38.662420 3050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d: Neither blocks nor log segments found. Creating new log.
I20260812 00:07:38.662693 3050 log.cc:824] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:38.663430 3050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d: No bootstrap required, opened a new log
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.125@KRBTEST.COM
I20260812 00:07:38.665469 3050 raft_consensus.cc:348] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } }
I20260812 00:07:38.665623 3050 raft_consensus.cc:374] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:07:38.665673 3050 raft_consensus.cc:729] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a504ff995a11446a9054a1d0ec82375d, State: Initialized, Role: FOLLOWER
I20260812 00:07:38.665800 3050 consensus_queue.cc:260] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } }
I20260812 00:07:38.666167 3050 sys_catalog.cc:564] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d [sys.catalog]: configured and running, proceeding with master startup.
W20260812 00:07:38.668030 3069 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:07:38.668087 3069 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:07:38.668545 2968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.660935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47780 (local address 127.19.59.125:35499)
0812 00:07:38.660975 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:38.660976 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:38.661015 (+ 39us) server_negotiation.cc:407] Connection header received
0812 00:07:38.661068 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:38.661068 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:38.661077 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:38.661125 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:38.661634 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.662324 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.663094 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.663322 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.663378 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.665739 (+ 2361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:38.665741 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:38.665741 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:38.665748 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:38.667420 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.667754 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.667755 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.667756 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.667812 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.668007 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.668008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.668008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.668132 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:38.668300 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:38.668378 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 00:07:38.668472 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:07:38.669729 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:07:38.669927 3056 sys_catalog.cc:455] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } } }
I20260812 00:07:38.670389 3056 sys_catalog.cc:458] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:07:38.668891 2971 master_runner.cc:186] Error getting master registration for 127.19.59.126:34149: OK, instance_id { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" instance_seqno: 1786493258336350 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:07:38.670962 2971 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:07:38.676306 2878 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } attempt: 2
I20260812 00:07:38.681672 3054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.674241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59282 (local address 127.19.59.124:37553)
0812 00:07:38.674270 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:38.674271 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:38.674454 (+ 183us) server_negotiation.cc:407] Connection header received
0812 00:07:38.674546 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:38.674547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:38.674555 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:38.674583 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:38.675305 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.676032 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.677053 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.677307 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.677339 (+ 32us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.678961 (+ 1622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:38.678962 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:38.678963 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:38.678970 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:38.680483 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.680876 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.680877 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.680878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.680940 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.681139 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.681140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.681140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.681290 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:38.681346 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:38.681529 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 00:07:38.681601 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 00:07:38.681773 2882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.674049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41728 (local address 127.19.59.126:34149)
0812 00:07:38.674082 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:38.674083 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:38.674785 (+ 702us) server_negotiation.cc:407] Connection header received
0812 00:07:38.674879 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:38.674880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:38.674906 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:38.674936 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:38.675611 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.676253 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.677507 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.677745 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.677805 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.679240 (+ 1435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:38.679241 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:38.679242 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:38.679247 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:38.680711 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.681060 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.681061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.681061 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.681105 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.681289 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.681290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.681290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.681394 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:38.681474 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:38.681639 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 00:07:38.681700 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for kudu/127.19.59.124@KRBTEST.COM
I20260812 00:07:38.688320 2881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.676527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:37553 (local address 127.0.0.1:59292)
0812 00:07:38.676604 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.676612 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:38.676641 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:38.682075 (+ 5434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:38.682076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:38.682200 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:38.682234 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.682236 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.683204 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.683205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.683810 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.683812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.684210 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.684211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.684252 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.684893 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:38.684897 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:38.686062 (+ 1165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:38.687456 (+ 1394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.687457 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.687457 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.687598 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.687768 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.687769 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.687770 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.687818 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.688046 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:38.688047 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:38.688081 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:07:38.688154 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 00:07:38.688233 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 00:07:38.688320 3054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.676693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59292 (local address 127.19.59.124:37553)
0812 00:07:38.681730 (+ 5037us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:38.681731 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:38.681737 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:07:38.681751 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:38.681752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:38.681759 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:38.682503 (+ 744us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:38.682541 (+ 38us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.683134 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.683879 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.684122 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.684168 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.686153 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:38.686154 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:38.686155 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:38.686161 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:38.687361 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.687661 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.687662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.687662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.687706 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.687882 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.687883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.687883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.687978 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:38.688039 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:38.688176 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 00:07:38.688233 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5025,"thread_start_us":71,"threads_started":1}
I20260812 00:07:38.689591 2878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a: Bootstrap starting.
I20260812 00:07:38.690220 2878 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a: Neither blocks nor log segments found. Creating new log.
I20260812 00:07:38.690498 2878 log.cc:824] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:38.691179 2878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a: No bootstrap required, opened a new log
I20260812 00:07:38.692548 2878 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } }
I20260812 00:07:38.692674 2878 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:07:38.692719 2878 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f0d62292394cbe990dd9f935394a0a, State: Initialized, Role: FOLLOWER
I20260812 00:07:38.692837 2878 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } }
I20260812 00:07:38.693091 3082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } } }
I20260812 00:07:38.693149 2878 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:07:38.693219 3082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:07:38.697343 2968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.674494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47790 (local address 127.19.59.125:35499)
0812 00:07:38.674524 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:38.674526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:38.682350 (+ 7824us) server_negotiation.cc:407] Connection header received
0812 00:07:38.682420 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:38.682421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:38.682429 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:38.682461 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:38.682905 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.683468 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.684222 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.684465 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.684502 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.694744 (+ 10242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:38.694745 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:38.694746 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:38.694752 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:38.696360 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.696662 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.696663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.696664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.696710 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.696896 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.696897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.696897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.696998 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:38.697083 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:38.697182 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 00:07:38.697248 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
W20260812 00:07:38.698350 3095 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:07:38.698402 3095 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:07:38.695973 2800 master_runner.cc:186] Error getting master registration for 127.19.59.125:35499: OK, instance_id { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" instance_seqno: 1786493258483791 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:07:38.698593 2800 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:07:38.718415 2964 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } attempt: 3
Aug 12 00:07:38 dist-test-slave-6nmv krb5kdc[2786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493258, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.125@KRBTEST.COM for kudu/127.19.59.124@KRBTEST.COM
I20260812 00:07:38.725756 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.718671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:37553 (local address 127.0.0.1:59302)
0812 00:07:38.718743 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:38.718752 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:38.718783 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:38.718986 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:38.718986 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:38.719138 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:38.719178 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.719180 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.719998 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.719999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.720723 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:38.720725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.721240 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.721241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:38.721286 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.721723 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:38.721728 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:38.723050 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:38.724677 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.724678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.724678 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.724887 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.725125 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:38.725126 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:38.725126 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:38.725185 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:38.725457 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:38.725458 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:38.725500 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 00:07:38.725562 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 00:07:38.725654 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 00:07:38.726161 3054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:38.718845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59302 (local address 127.19.59.124:37553)
0812 00:07:38.718877 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:38.718879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:38.718884 (+ 5us) server_negotiation.cc:407] Connection header received
0812 00:07:38.718902 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:38.718902 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:38.718910 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:38.718949 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:38.719248 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.719913 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.720827 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:38.721107 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:38.721175 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:38.723150 (+ 1975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:38.723151 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:38.723151 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:38.723158 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:38.724592 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.724988 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.724989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.724990 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.725046 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:38.725249 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:38.725250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:38.725251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:38.725372 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:38.725429 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:38.725958 (+ 529us) server_negotiation.cc:299] Negotiation successful
0812 00:07:38.726052 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:07:38.727573 2964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa: Bootstrap starting.
I20260812 00:07:38.728278 2964 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa: Neither blocks nor log segments found. Creating new log.
I20260812 00:07:38.728597 2964 log.cc:824] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:38.729334 2964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa: No bootstrap required, opened a new log
I20260812 00:07:38.731108 2964 raft_consensus.cc:348] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } }
I20260812 00:07:38.731244 2964 raft_consensus.cc:374] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:07:38.731279 2964 raft_consensus.cc:729] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccbcd328e6ec43719cbf7860303797aa, State: Initialized, Role: FOLLOWER
I20260812 00:07:38.731374 2964 consensus_queue.cc:260] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } }
I20260812 00:07:38.731669 2964 sys_catalog.cc:564] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:07:38.731935 3098 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } } }
I20260812 00:07:38.732064 3098 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:07:38.733254 3109 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:07:38.733345 3109 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:07:38.735136 2886 master_runner.cc:263] No leader master found from master ccbcd328e6ec43719cbf7860303797aa
I20260812 00:07:38.735189 2886 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:07:38.801151 3082 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:07:38.801265 3082 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } }
I20260812 00:07:38.801476 3082 leader_election.cc:288] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccbcd328e6ec43719cbf7860303797aa (127.19.59.125:35499), a504ff995a11446a9054a1d0ec82375d (127.19.59.124:37553)
I20260812 00:07:38.801765 2937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "15f0d62292394cbe990dd9f935394a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccbcd328e6ec43719cbf7860303797aa" is_pre_election: true
I20260812 00:07:38.801939 2937 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f0d62292394cbe990dd9f935394a0a in term 0.
I20260812 00:07:38.802208 2817 leader_election.cc:302] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f0d62292394cbe990dd9f935394a0a, ccbcd328e6ec43719cbf7860303797aa; no voters:
I20260812 00:07:38.802366 3082 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:07:38.802424 3082 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:07:38.802457 3082 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:07:38.803381 3082 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } }
I20260812 00:07:38.803506 3082 leader_election.cc:288] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [CANDIDATE]: Term 1 election: Requested vote from peers ccbcd328e6ec43719cbf7860303797aa (127.19.59.125:35499), a504ff995a11446a9054a1d0ec82375d (127.19.59.124:37553)
I20260812 00:07:38.803953 3020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "15f0d62292394cbe990dd9f935394a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a504ff995a11446a9054a1d0ec82375d" is_pre_election: true
I20260812 00:07:38.803972 3018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "15f0d62292394cbe990dd9f935394a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a504ff995a11446a9054a1d0ec82375d"
I20260812 00:07:38.804126 3020 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f0d62292394cbe990dd9f935394a0a in term 0.
I20260812 00:07:38.804298 2937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "15f0d62292394cbe990dd9f935394a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccbcd328e6ec43719cbf7860303797aa"
I20260812 00:07:38.804373 2937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:07:38.805195 2937 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f0d62292394cbe990dd9f935394a0a in term 1.
I20260812 00:07:38.805420 2817 leader_election.cc:302] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15f0d62292394cbe990dd9f935394a0a, ccbcd328e6ec43719cbf7860303797aa; no voters: a504ff995a11446a9054a1d0ec82375d
I20260812 00:07:38.805573 3082 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:07:38.805747 3082 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [term 1 LEADER]: Becoming Leader. State: Replica: 15f0d62292394cbe990dd9f935394a0a, State: Running, Role: LEADER
I20260812 00:07:38.806023 3082 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } }
I20260812 00:07:38.806444 3082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15f0d62292394cbe990dd9f935394a0a. Latest consensus state: current_term: 1 leader_uuid: "15f0d62292394cbe990dd9f935394a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } } }
I20260812 00:07:38.806541 3082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [sys.catalog]: This master's current role is: LEADER
I20260812 00:07:38.807286 3113 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:07:38.807502 3113 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:07:38.808881 3018 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:07:38.809762 3018 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d [term 1 FOLLOWER]: Refusing update from remote peer 15f0d62292394cbe990dd9f935394a0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:07:38.810122 3111 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:07:38.811286 3056 sys_catalog.cc:455] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15f0d62292394cbe990dd9f935394a0a. Latest consensus state: current_term: 1 leader_uuid: "15f0d62292394cbe990dd9f935394a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } } }
I20260812 00:07:38.811378 3056 sys_catalog.cc:458] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:07:38.811766 2937 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa [term 1 FOLLOWER]: Refusing update from remote peer 15f0d62292394cbe990dd9f935394a0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:07:38.812048 3111 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:07:38.813061 3098 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15f0d62292394cbe990dd9f935394a0a. Latest consensus state: current_term: 1 leader_uuid: "15f0d62292394cbe990dd9f935394a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } } }
I20260812 00:07:38.813170 3098 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:07:38.814314 3111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "15f0d62292394cbe990dd9f935394a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } } }
I20260812 00:07:38.814393 3111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [sys.catalog]: This master's current role is: LEADER
I20260812 00:07:38.814877 3098 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "15f0d62292394cbe990dd9f935394a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } } }
I20260812 00:07:38.814978 3098 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:07:38.815230 3114 mvcc.cc:205] Tried to move back new op lower bound from 7317476388079095808 to 7317476388070187008. Current Snapshot: MvccSnapshot[applied={T|T < 7317476388079095808}]
I20260812 00:07:38.815420 3117 mvcc.cc:205] Tried to move back new op lower bound from 7317476388079095808 to 7317476388070187008. Current Snapshot: MvccSnapshot[applied={T|T < 7317476388079095808}]
I20260812 00:07:38.816177 3082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "15f0d62292394cbe990dd9f935394a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } } }
I20260812 00:07:38.816269 3082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a [sys.catalog]: This master's current role is: LEADER
I20260812 00:07:38.817032 3056 sys_catalog.cc:455] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "15f0d62292394cbe990dd9f935394a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f0d62292394cbe990dd9f935394a0a" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 34149 } } peers { permanent_uuid: "ccbcd328e6ec43719cbf7860303797aa" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 35499 } } peers { permanent_uuid: "a504ff995a11446a9054a1d0ec82375d" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 37553 } } }
I20260812 00:07:38.817106 3056 sys_catalog.cc:458] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:07:38.818260 3113 catalog_manager.cc:1347] Generated new cluster ID: 9e93027714064cd4b899b4b1deac9858
I20260812 00:07:38.818312 3113 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:07:38.825538 3113 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:07:38.826318 3113 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:07:38.831974 3115 mvcc.cc:205] Tried to move back new op lower bound from 7317476388079095808 to 7317476388070187008. Current Snapshot: MvccSnapshot[applied={T|T < 7317476388079095808}]
I20260812 00:07:38.835103 3113 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15f0d62292394cbe990dd9f935394a0a: Generated new TSK 0
I20260812 00:07:38.835273 3113 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:07:39.668473 3069 catalog_manager.cc:1259] Loaded cluster ID: 9e93027714064cd4b899b4b1deac9858
I20260812 00:07:39.668541 3069 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d: loading cluster ID for follower catalog manager: success
I20260812 00:07:39.669265 3069 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d: acquiring CA information for follower catalog manager: success
I20260812 00:07:39.669577 3069 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a504ff995a11446a9054a1d0ec82375d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:07:39.733788 3109 catalog_manager.cc:1259] Loaded cluster ID: 9e93027714064cd4b899b4b1deac9858
I20260812 00:07:39.734006 3109 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa: loading cluster ID for follower catalog manager: success
I20260812 00:07:39.734766 3109 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa: acquiring CA information for follower catalog manager: success
I20260812 00:07:39.735077 3109 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ccbcd328e6ec43719cbf7860303797aa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:07:39.892179 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 2800
I20260812 00:07:39.900709 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 2886
I20260812 00:07:39.906792 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 2971
2026-08-12T00:07:39Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2806 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:07:39 dist-test-slave-6nmv krb5kdc[3134](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:07:39 dist-test-slave-6nmv krb5kdc[3134](info): set up 2 sockets
Aug 12 00:07:39 dist-test-slave-6nmv krb5kdc[3134](info): commencing operation
krb5kdc: starting...
W20260812 00:07:40.931730 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.005s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:07:41 dist-test-slave-6nmv krb5kdc[3134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:07:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:07:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:07:41.040639 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:43469
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:43469
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:07:41.113569 3151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:41.113791 3151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:41.113824 3151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:41.114943 3151 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:07:41.115008 3151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:41.115034 3151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:41.115064 3151 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:07:41.115109 3151 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:07:41.116556 3151 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:43469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:43469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:41.116806 3151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:41.117004 3151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:41.121435 3157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:41.121446 3158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:41.121464 3160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:41.121503 3151 server_base.cc:1034] running on GCE node
I20260812 00:07:41.121840 3151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:41.122114 3151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:41.123275 3151 hybrid_clock.cc:648] HybridClock initialized: now 1786493261123266 us; error 37 us; skew 500 ppm
Aug 12 00:07:41 dist-test-slave-6nmv krb5kdc[3134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493261, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:41.125502 3151 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:07:41.126009 3151 webserver.cc:460] Webserver started at http://127.19.59.126:35061/ using document root <none> and password file <none>
I20260812 00:07:41.126241 3151 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:41.126329 3151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:41.126502 3151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:07:41.127475 3151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "b5cf5f9b3b9e4116b9f9c523382d8807"
format_stamp: "Formatted at 2026-08-12 00:07:41 on dist-test-slave-6nmv"
server_key: "c0d6d67d5d914a86d7cac821112f743e"
server_key_iv: "ffa5a6669fa0262a06861db8b6d217d5"
server_key_version: "encryptionkey@0"
I20260812 00:07:41.127815 3151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "b5cf5f9b3b9e4116b9f9c523382d8807"
format_stamp: "Formatted at 2026-08-12 00:07:41 on dist-test-slave-6nmv"
server_key: "c0d6d67d5d914a86d7cac821112f743e"
server_key_iv: "ffa5a6669fa0262a06861db8b6d217d5"
server_key_version: "encryptionkey@0"
I20260812 00:07:41.128995 3151 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:07:41.129643 3167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:41.129802 3151 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:07:41.129920 3151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "b5cf5f9b3b9e4116b9f9c523382d8807"
format_stamp: "Formatted at 2026-08-12 00:07:41 on dist-test-slave-6nmv"
server_key: "c0d6d67d5d914a86d7cac821112f743e"
server_key_iv: "ffa5a6669fa0262a06861db8b6d217d5"
server_key_version: "encryptionkey@0"
I20260812 00:07:41.129966 3151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:41.153012 3151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:41.154580 3151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:41.154673 3151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:41.158443 3151 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:43469
I20260812 00:07:41.158511 3222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:43469 every 8 connection(s)
I20260812 00:07:41.158777 3151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:07:41.159543 3223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:07:41.161592 3223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807: Bootstrap starting.
I20260812 00:07:41.162178 3223 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807: Neither blocks nor log segments found. Creating new log.
I20260812 00:07:41.162459 3223 log.cc:824] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:41.163129 3223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807: No bootstrap required, opened a new log
I20260812 00:07:41.164512 3223 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5cf5f9b3b9e4116b9f9c523382d8807" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43469 } }
I20260812 00:07:41.164671 3223 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:07:41.164716 3223 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5cf5f9b3b9e4116b9f9c523382d8807, State: Initialized, Role: FOLLOWER
I20260812 00:07:41.164858 3223 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5cf5f9b3b9e4116b9f9c523382d8807" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43469 } }
I20260812 00:07:41.164932 3223 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:07:41.164966 3223 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:07:41.165011 3223 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:07:41.165153 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 3151
I20260812 00:07:41.165272 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:07:41.165458 19693 external_mini_cluster.cc:1428] Setting key eafcfc5777bb60acfde0e20b3b055e14
I20260812 00:07:41.165741 3223 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5cf5f9b3b9e4116b9f9c523382d8807" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43469 } }
I20260812 00:07:41.165879 3223 leader_election.cc:302] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5cf5f9b3b9e4116b9f9c523382d8807; no voters:
I20260812 00:07:41.166049 3223 leader_election.cc:288] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:07:41.166081 3228 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:07:41.166194 3228 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [term 1 LEADER]: Becoming Leader. State: Replica: b5cf5f9b3b9e4116b9f9c523382d8807, State: Running, Role: LEADER
I20260812 00:07:41.166286 3228 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5cf5f9b3b9e4116b9f9c523382d8807" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43469 } }
I20260812 00:07:41.166332 3223 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:07:41.166638 3231 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5cf5f9b3b9e4116b9f9c523382d8807" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5cf5f9b3b9e4116b9f9c523382d8807" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43469 } } }
I20260812 00:07:41.166718 3231 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [sys.catalog]: This master's current role is: LEADER
I20260812 00:07:41.166742 3232 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5cf5f9b3b9e4116b9f9c523382d8807. Latest consensus state: current_term: 1 leader_uuid: "b5cf5f9b3b9e4116b9f9c523382d8807" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5cf5f9b3b9e4116b9f9c523382d8807" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43469 } } }
I20260812 00:07:41.166818 3232 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807 [sys.catalog]: This master's current role is: LEADER
I20260812 00:07:41.166924 3237 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:07:41.167573 3237 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:07:41.170153 3237 catalog_manager.cc:1347] Generated new cluster ID: d737cb27abbc4de59b2ae29b155ddaad
I20260812 00:07:41.170202 3237 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:07:41 dist-test-slave-6nmv krb5kdc[3134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:41.177350 3230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:41.165922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34614 (local address 127.19.59.126:43469)
0812 00:07:41.166132 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:41.166141 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:41.166294 (+ 153us) server_negotiation.cc:407] Connection header received
0812 00:07:41.166567 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:41.166573 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:41.166624 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:41.167318 (+ 694us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:41.167794 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:41.168960 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:41.169920 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:41.170440 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:41.170543 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:41.173240 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:41.173245 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:41.173245 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:41.173256 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:41.175734 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:41.176123 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:41.176126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:41.176126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:41.176248 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:41.176467 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:41.176468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:41.176468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:41.176765 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:41.176924 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:41.177007 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 00:07:41.177155 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":99,"threads_started":1}
I20260812 00:07:41.178260 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:07:41.179932 3237 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:07:41.180347 3237 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:07:41.183387 3237 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5cf5f9b3b9e4116b9f9c523382d8807: Generated new TSK 0
I20260812 00:07:41.183547 3237 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:07:41.232244 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 3151
2026-08-12T00:07:41Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1326 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:07:41 dist-test-slave-6nmv krb5kdc[3254](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:07:41 dist-test-slave-6nmv krb5kdc[3254](info): set up 2 sockets
Aug 12 00:07:41 dist-test-slave-6nmv krb5kdc[3254](info): commencing operation
krb5kdc: starting...
W20260812 00:07:42.246132 19693 mini_kdc.cc:121] Time spent starting KDC: real 0.993s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:07:42 dist-test-slave-6nmv krb5kdc[3254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:07:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:07:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:07:42.356209 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:36449
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:36449
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:07:42.432042 3269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:42.432274 3269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:42.432312 3269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:42.433373 3269 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:07:42.433440 3269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:42.433465 3269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:42.433511 3269 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:07:42.433535 3269 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:07:42.434906 3269 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:36449
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:36449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:42.435156 3269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:42.435441 3269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:42.440085 3275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:42.440049 3274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:42.440258 3269 server_base.cc:1034] running on GCE node
W20260812 00:07:42.440053 3277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:42.440547 3269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:42.440829 3269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:42.441984 3269 hybrid_clock.cc:648] HybridClock initialized: now 1786493262441973 us; error 42 us; skew 500 ppm
Aug 12 00:07:42 dist-test-slave-6nmv krb5kdc[3254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493262, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:42.444470 3269 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:07:42.444859 3269 webserver.cc:460] Webserver started at http://127.19.59.126:38363/ using document root <none> and password file <none>
I20260812 00:07:42.445065 3269 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:42.445135 3269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:42.445309 3269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:07:42.446391 3269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "ebe6dc62ccf745eaa6d042dfcf045e06"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "9129f5657a80bd28f6495d529c853267"
server_key_iv: "dd436717213c7224ca93203787636ba9"
server_key_version: "encryptionkey@0"
I20260812 00:07:42.446756 3269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "ebe6dc62ccf745eaa6d042dfcf045e06"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "9129f5657a80bd28f6495d529c853267"
server_key_iv: "dd436717213c7224ca93203787636ba9"
server_key_version: "encryptionkey@0"
I20260812 00:07:42.447952 3269 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:07:42.448580 3286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:42.448745 3269 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:07:42.448845 3269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "ebe6dc62ccf745eaa6d042dfcf045e06"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "9129f5657a80bd28f6495d529c853267"
server_key_iv: "dd436717213c7224ca93203787636ba9"
server_key_version: "encryptionkey@0"
I20260812 00:07:42.448915 3269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:42.477165 3269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:42.479564 3269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:42.479724 3269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:42.483356 3269 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:36449
I20260812 00:07:42.483407 3345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:36449 every 8 connection(s)
I20260812 00:07:42.483774 3269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:07:42.484709 3346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:07:42.486996 3346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: Bootstrap starting.
I20260812 00:07:42.487572 3346 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: Neither blocks nor log segments found. Creating new log.
I20260812 00:07:42.487864 3346 log.cc:824] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:42.488549 3346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: No bootstrap required, opened a new log
I20260812 00:07:42.490199 3346 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } }
I20260812 00:07:42.490330 3346 raft_consensus.cc:374] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:07:42.490374 3346 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6dc62ccf745eaa6d042dfcf045e06, State: Initialized, Role: FOLLOWER
I20260812 00:07:42.490530 3346 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } }
I20260812 00:07:42.490595 3346 raft_consensus.cc:388] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:07:42.490674 3346 raft_consensus.cc:482] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:07:42.490723 3346 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:07:42.490828 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 3269
I20260812 00:07:42.490926 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:07:42.491107 19693 external_mini_cluster.cc:1428] Setting key bb03df4f50aa9702dc637778b6af184d
I20260812 00:07:42.491706 3346 raft_consensus.cc:504] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } }
I20260812 00:07:42.491829 3346 leader_election.cc:302] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ebe6dc62ccf745eaa6d042dfcf045e06; no voters:
I20260812 00:07:42.492056 3351 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:07:42.492030 3346 leader_election.cc:288] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:07:42.492247 3351 raft_consensus.cc:686] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 1 LEADER]: Becoming Leader. State: Replica: ebe6dc62ccf745eaa6d042dfcf045e06, State: Running, Role: LEADER
I20260812 00:07:42.492427 3346 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:07:42.492401 3351 consensus_queue.cc:237] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } }
I20260812 00:07:42.492805 3351 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } } }
I20260812 00:07:42.493046 3351 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [sys.catalog]: This master's current role is: LEADER
I20260812 00:07:42.492973 3352 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebe6dc62ccf745eaa6d042dfcf045e06. Latest consensus state: current_term: 1 leader_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } } }
I20260812 00:07:42.493450 3352 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [sys.catalog]: This master's current role is: LEADER
I20260812 00:07:42.493618 3361 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:07:42.494114 3361 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 00:07:42 dist-test-slave-6nmv krb5kdc[3254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:42.501417 3350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:42.491559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56848 (local address 127.19.59.126:36449)
0812 00:07:42.491765 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:42.491774 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:42.491808 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:07:42.491944 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:42.491951 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:42.492007 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:42.492165 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:42.492959 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:42.494297 (+ 1338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:42.495118 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:42.495737 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:42.495854 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:42.498396 (+ 2542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:42.498400 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:42.498401 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:42.498411 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:42.499978 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:42.500322 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:42.500324 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:42.500324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:42.500440 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:42.500642 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:42.500643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:42.500643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:42.500848 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:42.501025 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:42.501133 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 00:07:42.501259 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":130,"threads_started":1}
I20260812 00:07:42.501935 3361 catalog_manager.cc:1347] Generated new cluster ID: 3774b1f630ba4fb49ff7cc164cde63f2
I20260812 00:07:42.501982 3361 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:07:42.514359 3361 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:07:42.514798 3361 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:07:42.525054 3361 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: Generated new TSK 0
I20260812 00:07:42.525238 3361 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:07:42.558094 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:36449
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:07:42.661275 3378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:42.661442 3378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:42.661463 3378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:42.662496 3378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:42.662535 3378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:42.662559 3378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:07:42.663781 3378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:36449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:42.663929 3378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:42.664141 3378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:07:42.668799 3378 server_base.cc:1034] running on GCE node
W20260812 00:07:42.668771 3386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:42.668749 3385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:42.668751 3388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:42.669148 3378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:42.669384 3378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:42.670519 3378 hybrid_clock.cc:648] HybridClock initialized: now 1786493262670511 us; error 34 us; skew 500 ppm
Aug 12 00:07:42 dist-test-slave-6nmv krb5kdc[3254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493262, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:42.677516 3378 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:07:42.677970 3378 webserver.cc:460] Webserver started at http://127.19.59.65:46289/ using document root <none> and password file <none>
I20260812 00:07:42.678169 3378 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:42.678226 3378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:42.678349 3378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:07:42.679224 3378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "3ba7a4470c364b16b06d7eb60f1f2c46"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "5404648573ad5ae6dcd711865814ca54"
server_key_iv: "8b4652c2b5315989d4fadc95b2824550"
server_key_version: "encryptionkey@0"
I20260812 00:07:42.679544 3378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "3ba7a4470c364b16b06d7eb60f1f2c46"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "5404648573ad5ae6dcd711865814ca54"
server_key_iv: "8b4652c2b5315989d4fadc95b2824550"
server_key_version: "encryptionkey@0"
I20260812 00:07:42.680662 3378 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:07:42.681290 3396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:42.681445 3378 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:07:42.681533 3378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "3ba7a4470c364b16b06d7eb60f1f2c46"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "5404648573ad5ae6dcd711865814ca54"
server_key_iv: "8b4652c2b5315989d4fadc95b2824550"
server_key_version: "encryptionkey@0"
I20260812 00:07:42.681612 3378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:42.709344 3378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:42.711413 3378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:42.711555 3378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:42.711796 3378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:07:42.712075 3378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:07:42.712127 3378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:42.712164 3378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:07:42.712189 3378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:42.717890 3378 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:42775
I20260812 00:07:42.717963 3525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:42775 every 8 connection(s)
I20260812 00:07:42.718225 3378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:07:42.723214 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 3378
I20260812 00:07:42.723343 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:07:42.723575 19693 external_mini_cluster.cc:1428] Setting key 7e2e4eaf598770ccf6fd3bac723ee07e
Aug 12 00:07:42 dist-test-slave-6nmv krb5kdc[3254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493262, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:42.727032 3350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:42.718848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:54141 (local address 127.19.59.126:36449)
0812 00:07:42.718935 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:42.718937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:42.719048 (+ 111us) server_negotiation.cc:407] Connection header received
0812 00:07:42.719454 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:42.719455 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:42.719467 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:42.719524 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:42.720329 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:42.720846 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:42.721702 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:42.721941 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:42.721999 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:42.724315 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:42.724316 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:42.724316 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:42.724324 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:42.725509 (+ 1185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:42.726027 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:42.726028 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:42.726029 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:42.726105 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:42.726392 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:42.726393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:42.726393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:42.726517 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:42.726577 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:42.726913 (+ 336us) server_negotiation.cc:299] Negotiation successful
0812 00:07:42.726976 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 00:07:42.727241 3528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:42.718790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:54141)
0812 00:07:42.718929 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:42.718962 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:42.719374 (+ 412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:42.719591 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:42.719594 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:42.720072 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:42.720221 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:42.720225 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:42.720931 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:42.720932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:42.721626 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:42.721627 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:42.722012 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:42.722012 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:42.722178 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:42.722593 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:42.722600 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:42.724225 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:42.725605 (+ 1380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:42.725611 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:42.725613 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:42.725936 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:42.726178 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:42.726179 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:42.726180 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:42.726322 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:42.726605 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:42.726610 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:42.726794 (+ 184us) client_negotiation.cc:769] Sending connection context
0812 00:07:42.726894 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 00:07:42.727046 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":82,"threads_started":1}
I20260812 00:07:42.727662 3526 heartbeater.cc:347] Connected to a master server at 127.19.59.126:36449
I20260812 00:07:42.727756 3526 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:42.727901 3526 heartbeater.cc:511] Master 127.19.59.126:36449 requested a full tablet report, sending...
I20260812 00:07:42.728379 3306 ts_manager.cc:194] Registered new tserver with Master: 3ba7a4470c364b16b06d7eb60f1f2c46 (127.19.59.65:42775)
I20260812 00:07:42.729194 3306 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:54141
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:07:42.748064 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:36449
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:07:42.820116 3532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:42.820302 3532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:42.820322 3532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:42.821295 3532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:42.821331 3532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:42.821353 3532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:07:42.822606 3532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:36449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:42.822810 3532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:42.823011 3532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:42.827510 3539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:42.827492 3542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:42.827483 3537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:42.827648 3532 server_base.cc:1034] running on GCE node
I20260812 00:07:42.827875 3532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:42.828043 3532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:42.829200 3532 hybrid_clock.cc:648] HybridClock initialized: now 1786493262829190 us; error 34 us; skew 500 ppm
Aug 12 00:07:42 dist-test-slave-6nmv krb5kdc[3254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493262, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:42.831429 3532 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:07:42.831945 3532 webserver.cc:460] Webserver started at http://127.19.59.66:46855/ using document root <none> and password file <none>
I20260812 00:07:42.832180 3532 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:42.832253 3532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:42.832386 3532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:07:42.833305 3532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "adc6e6abc4fa44a386196441ab4040d9"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "3cd244e9aac0156fa5849a9205ab1f28"
server_key_iv: "98cc2511fbe6a8e2c56aad319149b0df"
server_key_version: "encryptionkey@0"
I20260812 00:07:42.833626 3532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "adc6e6abc4fa44a386196441ab4040d9"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "3cd244e9aac0156fa5849a9205ab1f28"
server_key_iv: "98cc2511fbe6a8e2c56aad319149b0df"
server_key_version: "encryptionkey@0"
I20260812 00:07:42.834848 3532 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:07:42.835554 3550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:42.835738 3532 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:07:42.835831 3532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "adc6e6abc4fa44a386196441ab4040d9"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "3cd244e9aac0156fa5849a9205ab1f28"
server_key_iv: "98cc2511fbe6a8e2c56aad319149b0df"
server_key_version: "encryptionkey@0"
I20260812 00:07:42.835917 3532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:42.842876 3532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:42.844408 3532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:42.844549 3532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:42.844746 3532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:07:42.845008 3532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:07:42.845057 3532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:42.845091 3532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:07:42.845140 3532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:42.850473 3532 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:33677
I20260812 00:07:42.850558 3674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:33677 every 8 connection(s)
I20260812 00:07:42.850847 3532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:07:42.852136 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 3532
I20260812 00:07:42.852236 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:07:42.852453 19693 external_mini_cluster.cc:1428] Setting key 16f86ec380ea3f458faeb0b82f813502
Aug 12 00:07:42 dist-test-slave-6nmv krb5kdc[3254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493262, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:42.860598 3350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:42.851484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:35219 (local address 127.19.59.126:36449)
0812 00:07:42.851551 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:42.851553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:42.851819 (+ 266us) server_negotiation.cc:407] Connection header received
0812 00:07:42.852453 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:42.852454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:42.852464 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:42.852538 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:42.853651 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:42.854137 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:42.855291 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:42.855607 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:42.855691 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:42.857839 (+ 2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:42.857841 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:42.857841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:42.857848 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:42.859231 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:42.859649 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:42.859651 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:42.859651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:42.859716 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:42.859973 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:42.859974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:42.859974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:42.860103 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:42.860175 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:42.860435 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 00:07:42.860516 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 00:07:42.860769 3677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:42.851437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:35219)
0812 00:07:42.851645 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:42.851728 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:42.852328 (+ 600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:42.852601 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:42.852606 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:42.853352 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:42.853570 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:42.853575 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:42.854217 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:42.854218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:42.855187 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:42.855189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:42.855698 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:42.855699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:42.855795 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:42.856260 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:42.856270 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:42.857737 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:42.859333 (+ 1596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:42.859340 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:42.859342 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:42.859569 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:42.859783 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:42.859784 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:42.859785 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:42.859897 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:42.860166 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:42.860173 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:42.860308 (+ 135us) client_negotiation.cc:769] Sending connection context
0812 00:07:42.860403 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 00:07:42.860554 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":76,"threads_started":1}
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
I20260812 00:07:42.861264 3675 heartbeater.cc:347] Connected to a master server at 127.19.59.126:36449
I20260812 00:07:42.861370 3675 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:42.861550 3675 heartbeater.cc:511] Master 127.19.59.126:36449 requested a full tablet report, sending...
I20260812 00:07:42.861961 3306 ts_manager.cc:194] Registered new tserver with Master: adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66:33677)
I20260812 00:07:42.862340 3306 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:35219
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:07:42.877283 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:36449
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:07:42.954623 3680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:42.954804 3680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:42.954826 3680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:42.955967 3680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:42.956015 3680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:42.956044 3680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:07:42.957363 3680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:36449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:42.957587 3680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:42.957798 3680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:42.962090 3690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:42.962097 3687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:42.962100 3688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:42.962229 3680 server_base.cc:1034] running on GCE node
I20260812 00:07:42.962435 3680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:42.962601 3680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:42.963730 3680 hybrid_clock.cc:648] HybridClock initialized: now 1786493262963719 us; error 30 us; skew 500 ppm
Aug 12 00:07:42 dist-test-slave-6nmv krb5kdc[3254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493262, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:42.966123 3680 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:07:42.966533 3680 webserver.cc:460] Webserver started at http://127.19.59.67:44305/ using document root <none> and password file <none>
I20260812 00:07:42.966756 3680 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:42.966797 3680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:42.966924 3680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:07:42.967823 3680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "d33d78ccf68d43288fb9fab381705709"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "ed4a0db9770c08e30654a76535d6ccd0"
server_key_iv: "429a3da5d60215313c1c5b1c56021723"
server_key_version: "encryptionkey@0"
I20260812 00:07:42.968156 3680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "d33d78ccf68d43288fb9fab381705709"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "ed4a0db9770c08e30654a76535d6ccd0"
server_key_iv: "429a3da5d60215313c1c5b1c56021723"
server_key_version: "encryptionkey@0"
I20260812 00:07:42.969437 3680 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:07:42.970170 3697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:42.970342 3680 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:42.970410 3680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "d33d78ccf68d43288fb9fab381705709"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "ed4a0db9770c08e30654a76535d6ccd0"
server_key_iv: "429a3da5d60215313c1c5b1c56021723"
server_key_version: "encryptionkey@0"
I20260812 00:07:42.970494 3680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:42.988683 3680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:42.990411 3680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:42.990556 3680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:42.990759 3680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:07:42.991039 3680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:07:42.991071 3680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:42.991130 3680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:07:42.991155 3680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:42.996968 3680 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:34325
I20260812 00:07:42.997007 3828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:34325 every 8 connection(s)
I20260812 00:07:42.997270 3680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:07:43.001720 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 3680
I20260812 00:07:43.001834 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:07:43.002004 19693 external_mini_cluster.cc:1428] Setting key c76027935d2622c92c7e8d4f1ffce6fa
Aug 12 00:07:43 dist-test-slave-6nmv krb5kdc[3254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493262, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:43.005558 3350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:42.997889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:42739 (local address 127.19.59.126:36449)
0812 00:07:42.997953 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:42.997955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:42.998136 (+ 181us) server_negotiation.cc:407] Connection header received
0812 00:07:42.998572 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:42.998573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:42.998583 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:42.998635 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:42.999466 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:42.999914 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.000775 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.000933 (+ 158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.000978 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.003224 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:43.003226 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:43.003226 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:43.003232 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:43.004421 (+ 1189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:43.004779 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:43.004780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:43.004780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:43.004833 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:43.005048 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:43.005048 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:43.005048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:43.005139 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:43.005185 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.005424 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.005487 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:07:43.005702 3832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:42.997893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:42739)
0812 00:07:42.998042 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:42.998074 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:42.998489 (+ 415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:42.998683 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:42.998686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:42.999229 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:42.999395 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:42.999399 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:42.999984 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:42.999985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.000708 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.000710 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.000998 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.000999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.001094 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.001481 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:43.001491 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:43.003134 (+ 1643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:43.004489 (+ 1355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:43.004495 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:43.004497 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:43.004713 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:43.004891 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:43.004892 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:43.004892 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:43.004998 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:43.005189 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:43.005193 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:43.005312 (+ 119us) client_negotiation.cc:769] Sending connection context
0812 00:07:43.005389 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:07:43.005500 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":86,"threads_started":1}
I20260812 00:07:43.006210 3829 heartbeater.cc:347] Connected to a master server at 127.19.59.126:36449
I20260812 00:07:43.006286 3829 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:43.006482 3829 heartbeater.cc:511] Master 127.19.59.126:36449 requested a full tablet report, sending...
I20260812 00:07:43.006887 3306 ts_manager.cc:194] Registered new tserver with Master: d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325)
I20260812 00:07:43.007233 3306 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:42739
I20260812 00:07:43.013480 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:07:43.019888 3350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.014804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56850 (local address 127.19.59.126:36449)
0812 00:07:43.014859 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.014861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.014953 (+ 92us) server_negotiation.cc:407] Connection header received
0812 00:07:43.014986 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.014987 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.014994 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.015036 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:43.015526 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.015961 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.016625 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.016770 (+ 145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.016811 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.017771 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:43.017772 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:43.017772 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:43.017777 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:43.019047 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:43.019338 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:43.019339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:43.019339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:43.019384 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:43.019529 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:43.019529 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:43.019529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:43.019636 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:43.019695 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.019768 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.019815 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:07:43.021145 3306 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56850:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:07:43.022637 3306 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:07:43.028465 3841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.024651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:34325 (local address 127.0.0.1:53712)
0812 00:07:43.025114 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:43.025121 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:43.025173 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:43.025415 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:43.025416 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:43.025418 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:07:43.025485 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.025487 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.026595 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.026596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.027616 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.027623 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.028182 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.028183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.028265 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.028276 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:07:43.028353 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:07:43.028403 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"mutex_wait_us":21,"thread_start_us":55,"threads_started":1}
I20260812 00:07:43.028470 3844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.024825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53712 (local address 127.19.59.67:34325)
0812 00:07:43.024982 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.024986 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.025172 (+ 186us) server_negotiation.cc:407] Connection header received
0812 00:07:43.025244 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.025246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.025262 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.025346 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:07:43.025573 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.026465 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.027693 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.028099 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.028179 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.028226 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.028377 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.028409 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":80,"threads_started":1}
I20260812 00:07:43.028496 3842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.024714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46822 (local address 127.19.59.66:33677)
0812 00:07:43.024893 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.024898 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.024999 (+ 101us) server_negotiation.cc:407] Connection header received
0812 00:07:43.025121 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.025122 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.025133 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.025214 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:07:43.025416 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.026406 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.027471 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.028107 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.028151 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.028199 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.028388 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.028425 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":96,"threads_started":1}
I20260812 00:07:43.028704 3839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.024628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:33677 (local address 127.0.0.1:46822)
0812 00:07:43.024903 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:43.024940 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:43.025016 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:43.025234 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:43.025237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:43.025239 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:07:43.025316 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.025318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.026532 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.026533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.027380 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.027382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.028253 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.028253 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.028313 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.028316 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:07:43.028586 (+ 270us) client_negotiation.cc:240] Negotiation successful
0812 00:07:43.028626 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":50,"threads_started":1}
I20260812 00:07:43.029299 3838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.024651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:42775 (local address 127.0.0.1:46774)
0812 00:07:43.025238 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:43.025245 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:43.025368 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:43.026029 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:43.026030 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:43.026032 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:07:43.026076 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.026078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.027237 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.027238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.028151 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.028154 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.029097 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.029097 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.029154 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.029157 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:07:43.029209 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 00:07:43.029244 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"mutex_wait_us":12,"thread_start_us":42,"threads_started":1}
I20260812 00:07:43.029331 3845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.024840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46774 (local address 127.19.59.65:42775)
0812 00:07:43.024983 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.024986 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.025330 (+ 344us) server_negotiation.cc:407] Connection header received
0812 00:07:43.025911 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.025914 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.025930 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.026014 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:07:43.026139 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.027130 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.028234 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.028961 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.029015 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.029065 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.029225 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.029267 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":86,"threads_started":1}
I20260812 00:07:43.029485 3602 tablet_service.cc:1467] Processing CreateTablet for tablet 8cbba116d2f8446c9448f3428d75cb1c (DEFAULT_TABLE table=test-table [id=b8c3626fc2db41bc99c00be638c13573]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:07:43.029479 3754 tablet_service.cc:1467] Processing CreateTablet for tablet 8cbba116d2f8446c9448f3428d75cb1c (DEFAULT_TABLE table=test-table [id=b8c3626fc2db41bc99c00be638c13573]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:07:43.029747 3602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cbba116d2f8446c9448f3428d75cb1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:07:43.029800 3754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cbba116d2f8446c9448f3428d75cb1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:07:43.031946 3846 tablet_bootstrap.cc:492] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9: Bootstrap starting.
I20260812 00:07:43.031944 3848 tablet_bootstrap.cc:492] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709: Bootstrap starting.
I20260812 00:07:43.032546 3846 tablet_bootstrap.cc:654] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9: Neither blocks nor log segments found. Creating new log.
I20260812 00:07:43.032696 3848 tablet_bootstrap.cc:654] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709: Neither blocks nor log segments found. Creating new log.
I20260812 00:07:43.032737 3449 tablet_service.cc:1467] Processing CreateTablet for tablet 8cbba116d2f8446c9448f3428d75cb1c (DEFAULT_TABLE table=test-table [id=b8c3626fc2db41bc99c00be638c13573]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:07:43.033072 3449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cbba116d2f8446c9448f3428d75cb1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:07:43.033058 3846 log.cc:824] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:43.033205 3848 log.cc:824] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:43.033725 3846 tablet_bootstrap.cc:492] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9: No bootstrap required, opened a new log
I20260812 00:07:43.033804 3846 ts_tablet_manager.cc:1397] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:07:43.033934 3848 tablet_bootstrap.cc:492] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709: No bootstrap required, opened a new log
I20260812 00:07:43.034003 3848 ts_tablet_manager.cc:1397] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:07:43.035066 3846 raft_consensus.cc:348] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } } peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } }
I20260812 00:07:43.035214 3846 raft_consensus.cc:374] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:07:43.035259 3846 raft_consensus.cc:729] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adc6e6abc4fa44a386196441ab4040d9, State: Initialized, Role: FOLLOWER
I20260812 00:07:43.035410 3846 consensus_queue.cc:260] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } } peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } }
I20260812 00:07:43.035696 3846 ts_tablet_manager.cc:1428] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:07:43.035837 3675 heartbeater.cc:503] Master 127.19.59.126:36449 was elected leader, sending a full tablet report...
I20260812 00:07:43.035897 3848 raft_consensus.cc:348] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } } peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } }
I20260812 00:07:43.036041 3848 raft_consensus.cc:374] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:07:43.036089 3848 raft_consensus.cc:729] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d33d78ccf68d43288fb9fab381705709, State: Initialized, Role: FOLLOWER
I20260812 00:07:43.036197 3848 consensus_queue.cc:260] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } } peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } }
I20260812 00:07:43.036485 3829 heartbeater.cc:503] Master 127.19.59.126:36449 was elected leader, sending a full tablet report...
I20260812 00:07:43.036468 3848 ts_tablet_manager.cc:1428] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:07:43.036926 3854 tablet_bootstrap.cc:492] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: Bootstrap starting.
I20260812 00:07:43.037549 3854 tablet_bootstrap.cc:654] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: Neither blocks nor log segments found. Creating new log.
I20260812 00:07:43.038040 3854 log.cc:824] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:43.038606 3854 tablet_bootstrap.cc:492] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: No bootstrap required, opened a new log
I20260812 00:07:43.038697 3854 ts_tablet_manager.cc:1397] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:07:43.039942 3854 raft_consensus.cc:348] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } } peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } }
I20260812 00:07:43.040064 3854 raft_consensus.cc:374] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:07:43.040103 3854 raft_consensus.cc:729] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba7a4470c364b16b06d7eb60f1f2c46, State: Initialized, Role: FOLLOWER
I20260812 00:07:43.040238 3854 consensus_queue.cc:260] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } } peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } }
I20260812 00:07:43.040472 3526 heartbeater.cc:503] Master 127.19.59.126:36449 was elected leader, sending a full tablet report...
I20260812 00:07:43.040684 3854 ts_tablet_manager.cc:1428] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260812 00:07:43.101418 3676 tablet.cc:2369] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:07:43.215974 3858 raft_consensus.cc:482] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:07:43.216089 3858 raft_consensus.cc:504] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } } peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } }
I20260812 00:07:43.216554 3858 leader_election.cc:288] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66:33677), d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325)
W20260812 00:07:43.218896 3527 tablet.cc:2369] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:07:43.220248 3844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.216895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:49563 (local address 127.19.59.67:34325)
0812 00:07:43.216946 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.216948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.216954 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:07:43.216992 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.216993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.217003 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.217052 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:07:43.217280 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.217951 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.219320 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.219872 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.219953 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.219961 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.220139 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.220179 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:07:43.220249 3842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.216806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:49697 (local address 127.19.59.66:33677)
0812 00:07:43.216860 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.216862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.216991 (+ 129us) server_negotiation.cc:407] Connection header received
0812 00:07:43.217021 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.217021 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.217033 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.217084 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:07:43.217280 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.217945 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.219321 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.219872 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.219953 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.219961 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.220143 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.220179 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:07:43.220266 3528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.216703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:34325 (local address 127.19.59.65:49563)
0812 00:07:43.216782 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:43.216795 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:43.216846 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:43.217093 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:43.217093 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:43.217095 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:07:43.217205 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.217207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.218022 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.218023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.219230 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.219233 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.219967 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.219968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.220054 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.220055 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 00:07:43.220113 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 00:07:43.220173 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":123}
I20260812 00:07:43.220273 3859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.216703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:33677 (local address 127.19.59.65:49697)
0812 00:07:43.216910 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:43.216919 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:43.216978 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:43.217096 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:43.217096 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:43.217097 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:07:43.217206 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.217207 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.218022 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.218023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.219230 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.219233 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.219967 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.219968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.220049 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.220053 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:07:43.220113 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:07:43.220172 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":144,"thread_start_us":75,"threads_started":1}
I20260812 00:07:43.220707 3626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cbba116d2f8446c9448f3428d75cb1c" candidate_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adc6e6abc4fa44a386196441ab4040d9" is_pre_election: true
I20260812 00:07:43.220763 3779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cbba116d2f8446c9448f3428d75cb1c" candidate_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d33d78ccf68d43288fb9fab381705709" is_pre_election: true
I20260812 00:07:43.220899 3626 raft_consensus.cc:2454] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ba7a4470c364b16b06d7eb60f1f2c46 in term 0.
I20260812 00:07:43.220945 3779 raft_consensus.cc:2454] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ba7a4470c364b16b06d7eb60f1f2c46 in term 0.
I20260812 00:07:43.221146 3400 leader_election.cc:302] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba7a4470c364b16b06d7eb60f1f2c46, d33d78ccf68d43288fb9fab381705709; no voters:
I20260812 00:07:43.221280 3858 raft_consensus.cc:2781] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:07:43.221333 3858 raft_consensus.cc:482] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:07:43.221354 3858 raft_consensus.cc:3037] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:07:43.222128 3858 raft_consensus.cc:504] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } } peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } }
I20260812 00:07:43.222276 3858 leader_election.cc:288] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 1 election: Requested vote from peers adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66:33677), d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325)
I20260812 00:07:43.222455 3626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cbba116d2f8446c9448f3428d75cb1c" candidate_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adc6e6abc4fa44a386196441ab4040d9"
I20260812 00:07:43.222455 3779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cbba116d2f8446c9448f3428d75cb1c" candidate_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d33d78ccf68d43288fb9fab381705709"
I20260812 00:07:43.222534 3626 raft_consensus.cc:3037] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:07:43.222534 3779 raft_consensus.cc:3037] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:07:43.223394 3626 raft_consensus.cc:2454] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba7a4470c364b16b06d7eb60f1f2c46 in term 1.
I20260812 00:07:43.223405 3779 raft_consensus.cc:2454] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba7a4470c364b16b06d7eb60f1f2c46 in term 1.
I20260812 00:07:43.223569 3400 leader_election.cc:302] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba7a4470c364b16b06d7eb60f1f2c46, d33d78ccf68d43288fb9fab381705709; no voters:
I20260812 00:07:43.223677 3858 raft_consensus.cc:2781] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:07:43.223819 3858 raft_consensus.cc:686] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 LEADER]: Becoming Leader. State: Replica: 3ba7a4470c364b16b06d7eb60f1f2c46, State: Running, Role: LEADER
I20260812 00:07:43.223922 3858 consensus_queue.cc:237] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } } peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } }
I20260812 00:07:43.224681 3306 catalog_manager.cc:5495] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ba7a4470c364b16b06d7eb60f1f2c46 (127.19.59.65). New cstate: current_term: 1 leader_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } health_report { overall_health: UNKNOWN } } }
W20260812 00:07:43.247730 3831 tablet.cc:2369] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:07:43.252807 3845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.250886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46790 (local address 127.19.59.65:42775)
0812 00:07:43.250939 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.250940 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.250958 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:07:43.251002 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.251002 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.251016 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.251067 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:07:43.251185 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.251549 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.252278 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.252428 (+ 150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.252474 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.252603 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:07:43.252677 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:07:43.252725 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.252737 (+ 12us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.252751 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:07:43.254236 3779 raft_consensus.cc:1261] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709 [term 1 FOLLOWER]: Refusing update from remote peer 3ba7a4470c364b16b06d7eb60f1f2c46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:07:43.254267 3626 raft_consensus.cc:1261] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9 [term 1 FOLLOWER]: Refusing update from remote peer 3ba7a4470c364b16b06d7eb60f1f2c46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:07:43.254554 3860 consensus_queue.cc:1035] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:07:43.254675 3858 consensus_queue.cc:1035] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:07:43.256758 3863 mvcc.cc:205] Tried to move back new op lower bound from 7317476406287220736 to 7317476406165819392. Current Snapshot: MvccSnapshot[applied={T|T < 7317476406287220736}]
I20260812 00:07:43.257931 3864 mvcc.cc:205] Tried to move back new op lower bound from 7317476406287220736 to 7317476406165819392. Current Snapshot: MvccSnapshot[applied={T|T < 7317476406287220736 or (T in {7317476406287220736})}]
I20260812 00:07:43.258181 3865 mvcc.cc:205] Tried to move back new op lower bound from 7317476406287220736 to 7317476406165819392. Current Snapshot: MvccSnapshot[applied={T|T < 7317476406287220736 or (T in {7317476406287220736})}]
I20260812 00:07:43.258941 3306 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:07:43.259048 3306 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:07:43.259764 3306 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: Sending DeleteTablet for 3 replicas of tablet 8cbba116d2f8446c9448f3428d75cb1c
I20260812 00:07:43.260110 3449 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cbba116d2f8446c9448f3428d75cb1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:07:43 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:46774
I20260812 00:07:43.260100 3602 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cbba116d2f8446c9448f3428d75cb1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:07:43 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:46822
I20260812 00:07:43.260183 3754 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cbba116d2f8446c9448f3428d75cb1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:07:43 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:53712
I20260812 00:07:43.260342 3872 tablet_replica.cc:330] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9: stopping tablet replica
I20260812 00:07:43.260398 3873 tablet_replica.cc:330] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: stopping tablet replica
I20260812 00:07:43.260401 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 3378
I20260812 00:07:43.260432 3872 raft_consensus.cc:2229] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:07:43.260470 3873 raft_consensus.cc:2229] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:07:43.260519 3872 raft_consensus.cc:2258] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:07:43.260543 3873 raft_consensus.cc:2258] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:07:43.260667 3874 tablet_replica.cc:330] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709: stopping tablet replica
I20260812 00:07:43.260752 3874 raft_consensus.cc:2229] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:07:43.260850 3874 raft_consensus.cc:2258] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:07:43.261029 3872 ts_tablet_manager.cc:1905] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:07:43.262622 3872 ts_tablet_manager.cc:1918] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:07:43.262653 3874 ts_tablet_manager.cc:1905] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:07:43.262686 3872 log.cc:1196] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/8cbba116d2f8446c9448f3428d75cb1c
I20260812 00:07:43.262970 3872 ts_tablet_manager.cc:1939] T 8cbba116d2f8446c9448f3428d75cb1c P adc6e6abc4fa44a386196441ab4040d9: Deleting consensus metadata
I20260812 00:07:43.263329 3290 catalog_manager.cc:4841] TS adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66:33677): tablet 8cbba116d2f8446c9448f3428d75cb1c (table test-table [id=b8c3626fc2db41bc99c00be638c13573]) successfully deleted
I20260812 00:07:43.264144 3874 ts_tablet_manager.cc:1918] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:07:43.264194 3874 log.cc:1196] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/8cbba116d2f8446c9448f3428d75cb1c
I20260812 00:07:43.264386 3874 ts_tablet_manager.cc:1939] T 8cbba116d2f8446c9448f3428d75cb1c P d33d78ccf68d43288fb9fab381705709: Deleting consensus metadata
I20260812 00:07:43.264700 3291 catalog_manager.cc:4841] TS d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325): tablet 8cbba116d2f8446c9448f3428d75cb1c (table test-table [id=b8c3626fc2db41bc99c00be638c13573]) successfully deleted
W20260812 00:07:43.269217 3287 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:42775 (error 108)
I20260812 00:07:43.269487 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 3532
I20260812 00:07:43.269775 3839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.269647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:42775 (local address 127.0.0.1:46796)
0812 00:07:43.269708 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:43.269742 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:42775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 00:07:43.270355 3287 catalog_manager.cc:4584] TS 3ba7a4470c364b16b06d7eb60f1f2c46 (127.19.59.65:42775): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8cbba116d2f8446c9448f3428d75cb1c: Network error: Client connection negotiation failed: client connection to 127.19.59.65:42775: connect: Connection refused (error 111)
I20260812 00:07:43.275875 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 3680
I20260812 00:07:43.281873 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 3269
I20260812 00:07:43.288287 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:36449
--webserver_interface=127.19.59.126
--webserver_port=38363
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:36449
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:07:43.362141 3876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:43.362305 3876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:43.362324 3876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:43.363294 3876 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:07:43.363330 3876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:43.363343 3876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:43.363353 3876 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:07:43.363401 3876 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:07:43.364619 3876 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:36449
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:36449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=38363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:43.364770 3876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:43.364975 3876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:43.373348 3883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:43.373356 3882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:43.373363 3886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:43.373668 3876 server_base.cc:1034] running on GCE node
I20260812 00:07:43.373934 3876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:43.374262 3876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:43.375402 3876 hybrid_clock.cc:648] HybridClock initialized: now 1786493263375400 us; error 32 us; skew 500 ppm
Aug 12 00:07:43 dist-test-slave-6nmv krb5kdc[3254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493263, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:43.377748 3876 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:07:43.378137 3876 webserver.cc:460] Webserver started at http://127.19.59.126:38363/ using document root <none> and password file <none>
I20260812 00:07:43.378297 3876 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:43.378340 3876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:43.379545 3876 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:07:43.380167 3894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:43.380353 3876 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:07:43.380451 3876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "ebe6dc62ccf745eaa6d042dfcf045e06"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "9129f5657a80bd28f6495d529c853267"
server_key_iv: "dd436717213c7224ca93203787636ba9"
server_key_version: "encryptionkey@0"
I20260812 00:07:43.380780 3876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:43.391503 3876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:43.393581 3876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:43.393739 3876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:43.397327 3876 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:36449
I20260812 00:07:43.397387 3955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:36449 every 8 connection(s)
I20260812 00:07:43.397734 3876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:07:43.399241 3958 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:07:43.399859 3958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: Bootstrap starting.
I20260812 00:07:43.403295 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 3876
I20260812 00:07:43.403607 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:42775
--local_ip_for_outbound_sockets=127.19.59.65
--tserver_master_addrs=127.19.59.126:36449
--webserver_port=46289
--webserver_interface=127.19.59.65
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:07:43.408183 3958 log.cc:824] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:43.409935 3958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:07:43.410198 3958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: Bootstrap complete.
I20260812 00:07:43.412379 3958 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } }
I20260812 00:07:43.412585 3958 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6dc62ccf745eaa6d042dfcf045e06, State: Initialized, Role: FOLLOWER
I20260812 00:07:43.412756 3958 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } }
I20260812 00:07:43.412824 3958 raft_consensus.cc:388] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:07:43.412894 3958 raft_consensus.cc:482] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:07:43.412941 3958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:07:43.414059 3958 raft_consensus.cc:504] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } }
I20260812 00:07:43.414145 3958 leader_election.cc:302] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ebe6dc62ccf745eaa6d042dfcf045e06; no voters:
I20260812 00:07:43.414342 3958 leader_election.cc:288] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:07:43.414391 3962 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:07:43.414604 3962 raft_consensus.cc:686] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 2 LEADER]: Becoming Leader. State: Replica: ebe6dc62ccf745eaa6d042dfcf045e06, State: Running, Role: LEADER
I20260812 00:07:43.414685 3958 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:07:43.414739 3962 consensus_queue.cc:237] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } }
I20260812 00:07:43.414995 3962 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebe6dc62ccf745eaa6d042dfcf045e06. Latest consensus state: current_term: 2 leader_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } } }
I20260812 00:07:43.415066 3962 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [sys.catalog]: This master's current role is: LEADER
I20260812 00:07:43.415212 3964 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } } }
I20260812 00:07:43.415292 3964 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [sys.catalog]: This master's current role is: LEADER
I20260812 00:07:43.415577 3967 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:07:43.416349 3967 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:07:43.416458 3967 catalog_manager.cc:1259] Loaded cluster ID: 3774b1f630ba4fb49ff7cc164cde63f2
I20260812 00:07:43.416495 3967 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:07:43.416718 3967 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 00:07:43.421016 3967 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 00:07:43.423518 3967 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:07:43.423713 3967 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: Loaded TSK: 0
I20260812 00:07:43.423919 3967 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:07:43.479069 3960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:43.479274 3960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:43.479310 3960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:43.480278 3960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:43.480333 3960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:43.480374 3960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:07:43.481618 3960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:42775
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=46289
--tserver_master_addrs=127.19.59.126:36449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:43.481885 3960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:43.482079 3960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:43.486723 3988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:43.486794 3985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:43.486729 3986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:43.487541 3960 server_base.cc:1034] running on GCE node
I20260812 00:07:43.487748 3960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:43.487968 3960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:43.489112 3960 hybrid_clock.cc:648] HybridClock initialized: now 1786493263489103 us; error 28 us; skew 500 ppm
Aug 12 00:07:43 dist-test-slave-6nmv krb5kdc[3254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493263, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:43.491792 3960 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:07:43.492249 3960 webserver.cc:460] Webserver started at http://127.19.59.65:46289/ using document root <none> and password file <none>
I20260812 00:07:43.492492 3960 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:43.492548 3960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:43.493848 3960 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:07:43.494501 3995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:43.494660 3960 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:07:43.494747 3960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "3ba7a4470c364b16b06d7eb60f1f2c46"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "5404648573ad5ae6dcd711865814ca54"
server_key_iv: "8b4652c2b5315989d4fadc95b2824550"
server_key_version: "encryptionkey@0"
I20260812 00:07:43.495081 3960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:43.516407 3960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:43.518362 3960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:43.518507 3960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:43.518704 3960 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:07:43.519160 4003 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 00:07:43.520977 3960 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 00:07:43.521041 3960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 00:07:43.521082 3960 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 00:07:43.521610 3960 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 00:07:43.521665 3960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 00:07:43.521714 4003 tablet_bootstrap.cc:492] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: Bootstrap starting.
I20260812 00:07:43.528542 3960 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:42775
I20260812 00:07:43.528888 3960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:07:43.529109 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 3960
I20260812 00:07:43.529389 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:33677
--local_ip_for_outbound_sockets=127.19.59.66
--tserver_master_addrs=127.19.59.126:36449
--webserver_port=46855
--webserver_interface=127.19.59.66
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:07:43.531845 4126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:42775 every 8 connection(s)
I20260812 00:07:43.533926 4003 log.cc:824] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:43.535957 4003 tablet_bootstrap.cc:492] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:07:43.536257 4003 tablet_bootstrap.cc:492] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: Bootstrap complete.
I20260812 00:07:43.537468 4003 ts_tablet_manager.cc:1397] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.008s
I20260812 00:07:43.538571 4003 raft_consensus.cc:348] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } } peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } }
I20260812 00:07:43.538787 4003 raft_consensus.cc:729] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba7a4470c364b16b06d7eb60f1f2c46, State: Initialized, Role: FOLLOWER
I20260812 00:07:43.538934 4003 consensus_queue.cc:260] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } } peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } }
I20260812 00:07:43.539177 4003 ts_tablet_manager.cc:1428] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: Time spent starting tablet: real 0.002s user 0.000s sys 0.004s
Aug 12 00:07:43 dist-test-slave-6nmv krb5kdc[3254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493263, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:43.545008 4131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.531150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:54455 (local address 127.19.59.126:36449)
0812 00:07:43.531322 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.531331 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.531365 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:07:43.531491 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.531497 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.531547 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.531701 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:43.536779 (+ 5078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.538084 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.539446 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.539771 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.539845 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.541972 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:43.541975 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:43.541976 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:43.541985 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:43.543530 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:43.543926 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:43.543928 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:43.543928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:43.544005 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:43.544237 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:43.544238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:43.544238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:43.544428 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:43.544496 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.544795 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.544888 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
I20260812 00:07:43.545091 4129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.529581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:54455)
0812 00:07:43.529753 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:43.529789 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:43.530193 (+ 404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:43.531835 (+ 1642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:43.531839 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:43.536310 (+ 4471us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:43.536632 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.536639 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.538184 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.538185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.539357 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.539361 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.539858 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.539860 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.539994 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.540474 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:43.540482 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:43.541885 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:43.543595 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:43.543600 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:43.543602 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:43.543845 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:43.544062 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:43.544063 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:43.544063 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:43.544176 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:43.544497 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:43.544501 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:43.544632 (+ 131us) client_negotiation.cc:769] Sending connection context
0812 00:07:43.544735 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 00:07:43.544876 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":94,"threads_started":1}
I20260812 00:07:43.545879 4127 heartbeater.cc:347] Connected to a master server at 127.19.59.126:36449
I20260812 00:07:43.545972 4127 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:43.546149 4127 heartbeater.cc:511] Master 127.19.59.126:36449 requested a full tablet report, sending...
I20260812 00:07:43.546886 3914 ts_manager.cc:194] Registered new tserver with Master: 3ba7a4470c364b16b06d7eb60f1f2c46 (127.19.59.65:42775)
I20260812 00:07:43.547924 3914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:54455
I20260812 00:07:43.548774 4127 heartbeater.cc:503] Master 127.19.59.126:36449 was elected leader, sending a full tablet report...
I20260812 00:07:43.554311 4136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.547627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46806 (local address 127.19.59.65:42775)
0812 00:07:43.551691 (+ 4064us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.551694 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.551703 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:07:43.551727 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.551728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.551739 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.551821 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:07:43.551983 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.552594 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.553475 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.553934 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.554007 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.554053 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.554218 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.554251 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4039,"thread_start_us":75,"threads_started":1}
I20260812 00:07:43.554312 4134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.547420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:42775 (local address 127.0.0.1:46806)
0812 00:07:43.547576 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:43.547617 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:43.547678 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:43.551842 (+ 4164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:43.551844 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:43.551847 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:07:43.551906 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.551907 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.552683 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.552683 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.553390 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.553392 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.554018 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.554019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.554120 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.554130 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 00:07:43.554202 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 00:07:43.554252 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":103,"threads_started":1}
I20260812 00:07:43.554705 4048 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cbba116d2f8446c9448f3428d75cb1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:07:43 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:46806
I20260812 00:07:43.555183 4137 tablet_replica.cc:330] stopping tablet replica
I20260812 00:07:43.555287 4137 raft_consensus.cc:2229] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:07:43.555377 4137 raft_consensus.cc:2258] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:07:43.555661 4137 ts_tablet_manager.cc:1905] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:07:43.557567 4137 ts_tablet_manager.cc:1918] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:07:43.557662 4137 log.cc:1196] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal/wals/8cbba116d2f8446c9448f3428d75cb1c
I20260812 00:07:43.557942 4137 ts_tablet_manager.cc:1939] T 8cbba116d2f8446c9448f3428d75cb1c P 3ba7a4470c364b16b06d7eb60f1f2c46: Deleting consensus metadata
I20260812 00:07:43.558373 3896 catalog_manager.cc:4841] TS 3ba7a4470c364b16b06d7eb60f1f2c46 (127.19.59.65:42775): tablet 8cbba116d2f8446c9448f3428d75cb1c (table test-table [id=b8c3626fc2db41bc99c00be638c13573]) successfully deleted
W20260812 00:07:43.608769 4130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:43.608928 4130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:43.608948 4130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:43.609898 4130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:43.609934 4130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:43.609956 4130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:07:43.611121 4130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:33677
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=46855
--tserver_master_addrs=127.19.59.126:36449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:43.611263 4130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:43.611415 4130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:43.615841 4142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:43.615834 4146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:43.615818 4143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:43.616261 4130 server_base.cc:1034] running on GCE node
I20260812 00:07:43.616441 4130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:43.616647 4130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:43.617799 4130 hybrid_clock.cc:648] HybridClock initialized: now 1786493263617782 us; error 33 us; skew 500 ppm
Aug 12 00:07:43 dist-test-slave-6nmv krb5kdc[3254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493263, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:43.619935 4130 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:07:43.620287 4130 webserver.cc:460] Webserver started at http://127.19.59.66:46855/ using document root <none> and password file <none>
I20260812 00:07:43.620476 4130 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:43.620551 4130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:43.621635 4130 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:07:43.622179 4153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:43.622334 4130 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:43.622419 4130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "adc6e6abc4fa44a386196441ab4040d9"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "3cd244e9aac0156fa5849a9205ab1f28"
server_key_iv: "98cc2511fbe6a8e2c56aad319149b0df"
server_key_version: "encryptionkey@0"
I20260812 00:07:43.622694 4130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:43.652981 4130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:43.654640 4130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:43.654778 4130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:43.654984 4130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:07:43.655200 4130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:07:43.655225 4130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:43.655243 4130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:07:43.655256 4130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:43.660336 4130 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:33677
I20260812 00:07:43.660418 4278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:33677 every 8 connection(s)
I20260812 00:07:43.660705 4130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:07:43.665091 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 4130
I20260812 00:07:43.665351 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:34325
--local_ip_for_outbound_sockets=127.19.59.67
--tserver_master_addrs=127.19.59.126:36449
--webserver_port=44305
--webserver_interface=127.19.59.67
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:07:43 dist-test-slave-6nmv krb5kdc[3254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493263, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:43.675257 4281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.661329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:52567)
0812 00:07:43.661509 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:43.661543 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:43.662013 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:43.662204 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:43.662206 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:43.662676 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:43.662829 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.662833 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.663424 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.663424 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.664214 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.664216 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.664527 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.664528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.664616 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.670860 (+ 6244us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:43.670867 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:43.672352 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:43.674123 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:43.674128 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:43.674130 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:43.674310 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:43.674515 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:43.674515 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:43.674516 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:43.674604 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:43.674873 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:43.674877 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:43.674965 (+ 88us) client_negotiation.cc:769] Sending connection context
0812 00:07:43.675031 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 00:07:43.675127 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":111,"threads_started":1}
I20260812 00:07:43.675275 4131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.661361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:52567 (local address 127.19.59.126:36449)
0812 00:07:43.661454 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.661457 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.661625 (+ 168us) server_negotiation.cc:407] Connection header received
0812 00:07:43.662107 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.662108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.662117 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.662163 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:43.662913 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.663350 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.664296 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.664465 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.664509 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.672453 (+ 7944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:43.672455 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:43.672456 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:43.672463 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:43.674037 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:43.674382 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:43.674383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:43.674384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:43.674447 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:43.674667 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:43.674668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:43.674668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:43.674809 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:43.674882 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.675081 (+ 199us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.675173 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 00:07:43.675776 4279 heartbeater.cc:347] Connected to a master server at 127.19.59.126:36449
I20260812 00:07:43.675879 4279 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:43.676056 4279 heartbeater.cc:511] Master 127.19.59.126:36449 requested a full tablet report, sending...
I20260812 00:07:43.676445 3914 ts_manager.cc:194] Registered new tserver with Master: adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66:33677)
I20260812 00:07:43.676911 3914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:52567
W20260812 00:07:43.740578 4283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:43.740741 4283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:43.740761 4283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:43.741676 4283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:43.741708 4283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:43.741730 4283 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:07:43.742941 4283 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:34325
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=44305
--tserver_master_addrs=127.19.59.126:36449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4283
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:43.743088 4283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:43.743228 4283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:43.747793 4289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:43.747838 4292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:43.748006 4283 server_base.cc:1034] running on GCE node
W20260812 00:07:43.747828 4290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:43.748237 4283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:43.748423 4283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:43.749549 4283 hybrid_clock.cc:648] HybridClock initialized: now 1786493263749540 us; error 24 us; skew 500 ppm
Aug 12 00:07:43 dist-test-slave-6nmv krb5kdc[3254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493263, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:43.751890 4283 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:07:43.752350 4283 webserver.cc:460] Webserver started at http://127.19.59.67:44305/ using document root <none> and password file <none>
I20260812 00:07:43.752518 4283 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:43.752568 4283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:43.753898 4283 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:07:43.754415 4299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:43.754592 4283 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:43.754701 4283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "d33d78ccf68d43288fb9fab381705709"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "ed4a0db9770c08e30654a76535d6ccd0"
server_key_iv: "429a3da5d60215313c1c5b1c56021723"
server_key_version: "encryptionkey@0"
I20260812 00:07:43.754978 4283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:43.766824 4283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:43.768442 4283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:43.768582 4283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:43.768775 4283 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:07:43.769028 4283 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:07:43.769078 4283 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:43.769124 4283 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:07:43.769147 4283 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:43.774855 4283 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:34325
I20260812 00:07:43.774887 4424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:34325 every 8 connection(s)
I20260812 00:07:43.775182 4283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:07:43 dist-test-slave-6nmv krb5kdc[3254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493263, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:07:43.780398 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 4283
I20260812 00:07:43.783851 4131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.775905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:60703 (local address 127.19.59.126:36449)
0812 00:07:43.775971 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.775972 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.776149 (+ 177us) server_negotiation.cc:407] Connection header received
0812 00:07:43.776581 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.776582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.776601 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.776648 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:43.777367 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.777860 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.778706 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.778879 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.778925 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.780666 (+ 1741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:43.780668 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:43.780668 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:43.780688 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:43.782330 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:43.782851 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:43.782852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:43.782852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:43.782915 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:43.783203 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:43.783203 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:43.783204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:43.783344 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:43.783414 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.783688 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.783755 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 00:07:43.784121 4428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.775876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:60703)
0812 00:07:43.776024 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:43.776061 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:43.776488 (+ 427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:43.776687 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:43.776689 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:43.777153 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:43.777303 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.777307 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.777929 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.777930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.778630 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.778632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.778943 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.778944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.779024 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.779371 (+ 347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:43.779377 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:43.780557 (+ 1180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:43.782410 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:43.782418 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:43.782420 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:43.782742 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:43.783011 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:43.783012 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:43.783012 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:43.783129 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:43.783421 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:43.783427 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:43.783561 (+ 134us) client_negotiation.cc:769] Sending connection context
0812 00:07:43.783665 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 00:07:43.783821 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":86,"threads_started":1}
I20260812 00:07:43.784756 4425 heartbeater.cc:347] Connected to a master server at 127.19.59.126:36449
I20260812 00:07:43.784847 4425 heartbeater.cc:464] Registering TS with master...
I20260812 00:07:43.784994 4425 heartbeater.cc:511] Master 127.19.59.126:36449 requested a full tablet report, sending...
I20260812 00:07:43.785391 3914 ts_manager.cc:194] Registered new tserver with Master: d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325)
I20260812 00:07:43.785779 3914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:60703
I20260812 00:07:43.787472 4430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.780770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56862 (local address 127.19.59.126:36449)
0812 00:07:43.780884 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.780886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.780961 (+ 75us) server_negotiation.cc:407] Connection header received
0812 00:07:43.781003 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.781004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.781015 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.781083 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:43.781893 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.782407 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.783415 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.783755 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.783820 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.785136 (+ 1316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:43.785137 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:43.785138 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:43.785143 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:43.786680 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:43.786959 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:43.786959 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:43.786959 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:43.786999 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:43.787127 (+ 128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:43.787127 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:43.787128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:43.787195 (+ 67us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:43.787293 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.787314 (+ 21us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.787367 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":54,"threads_started":1}
I20260812 00:07:43.788107 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:07:43.790211 4430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.788402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56874 (local address 127.19.59.126:36449)
0812 00:07:43.788428 (+ 26us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.788430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.788493 (+ 63us) server_negotiation.cc:407] Connection header received
0812 00:07:43.788544 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.788544 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.788567 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.788622 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:07:43.788682 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.789028 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.789596 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.789770 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.789868 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.789993 (+ 125us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:07:43.790069 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:07:43.790129 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.790158 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.790175 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260812 00:07:43.790449 3914 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:56874:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:07:43.792061 3914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:07:43.793995 4048 tablet_service.cc:1467] Processing CreateTablet for tablet 3c3d10fd7e3e48159202ecb1fc40c867 (DEFAULT_TABLE table=test-table [id=4e718707e59341da8ca84dd5f9d8c27a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:07:43.794201 4048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c3d10fd7e3e48159202ecb1fc40c867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:07:43.795635 4003 tablet_bootstrap.cc:492] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46: Bootstrap starting.
I20260812 00:07:43.795979 4003 tablet_bootstrap.cc:654] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46: Neither blocks nor log segments found. Creating new log.
I20260812 00:07:43.796597 4003 tablet_bootstrap.cc:492] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46: No bootstrap required, opened a new log
I20260812 00:07:43.796686 4003 ts_tablet_manager.cc:1397] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260812 00:07:43.796797 4003 raft_consensus.cc:348] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } }
I20260812 00:07:43.796882 4003 raft_consensus.cc:374] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:07:43.796931 4003 raft_consensus.cc:729] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba7a4470c364b16b06d7eb60f1f2c46, State: Initialized, Role: FOLLOWER
I20260812 00:07:43.796991 4003 consensus_queue.cc:260] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } }
I20260812 00:07:43.797108 4003 ts_tablet_manager.cc:1428] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:43.797502 4134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.793689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:34325 (local address 127.0.0.1:53718)
0812 00:07:43.793723 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:43.793733 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:43.793768 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:43.794225 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:43.794225 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:43.794227 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:07:43.794254 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.794255 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.795270 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.795270 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.796187 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.796190 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.797266 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.797267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.797335 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.797338 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:07:43.797395 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 00:07:43.797427 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260812 00:07:43.797518 4433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.793863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53718 (local address 127.19.59.67:34325)
0812 00:07:43.794008 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.794012 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.794021 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:07:43.794050 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.794051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.794063 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.794231 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:07:43.794328 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.795175 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.796274 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.797182 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.797266 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.797322 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.797412 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.797450 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
I20260812 00:07:43.798493 4352 tablet_service.cc:1467] Processing CreateTablet for tablet 3c3d10fd7e3e48159202ecb1fc40c867 (DEFAULT_TABLE table=test-table [id=4e718707e59341da8ca84dd5f9d8c27a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:07:43.798804 4352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c3d10fd7e3e48159202ecb1fc40c867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:07:43.799767 4432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.793730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:33677 (local address 127.0.0.1:46832)
0812 00:07:43.795684 (+ 1954us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:43.795696 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:43.795747 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:43.795978 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:43.795979 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:43.795981 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:07:43.796090 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.796092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.797768 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.797768 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.798880 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.798883 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.799520 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.799521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.799583 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.799586 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:07:43.799655 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 00:07:43.799694 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1936,"thread_start_us":96,"threads_started":1}
I20260812 00:07:43.799796 4434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.793967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46832 (local address 127.19.59.66:33677)
0812 00:07:43.794121 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.794125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.795813 (+ 1688us) server_negotiation.cc:407] Connection header received
0812 00:07:43.795863 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.795865 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.795880 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.795982 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:07:43.796182 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.797673 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.798955 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.799429 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.799488 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.799519 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.799679 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.799718 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":94,"threads_started":1}
I20260812 00:07:43.800467 4204 tablet_service.cc:1467] Processing CreateTablet for tablet 3c3d10fd7e3e48159202ecb1fc40c867 (DEFAULT_TABLE table=test-table [id=4e718707e59341da8ca84dd5f9d8c27a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:07:43.800760 4204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c3d10fd7e3e48159202ecb1fc40c867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:07:43.801630 4438 tablet_bootstrap.cc:492] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709: Bootstrap starting.
I20260812 00:07:43.802335 4438 tablet_bootstrap.cc:654] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709: Neither blocks nor log segments found. Creating new log.
I20260812 00:07:43.802837 4438 log.cc:824] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:43.803582 4438 tablet_bootstrap.cc:492] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709: No bootstrap required, opened a new log
I20260812 00:07:43.803655 4438 ts_tablet_manager.cc:1397] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:07:43.803995 4440 tablet_bootstrap.cc:492] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9: Bootstrap starting.
I20260812 00:07:43.804551 4440 tablet_bootstrap.cc:654] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9: Neither blocks nor log segments found. Creating new log.
I20260812 00:07:43.805112 4440 log.cc:824] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:43.805156 4438 raft_consensus.cc:348] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } }
I20260812 00:07:43.805313 4438 raft_consensus.cc:374] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:07:43.805378 4438 raft_consensus.cc:729] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d33d78ccf68d43288fb9fab381705709, State: Initialized, Role: FOLLOWER
I20260812 00:07:43.805527 4438 consensus_queue.cc:260] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } }
I20260812 00:07:43.805882 4438 ts_tablet_manager.cc:1428] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:07:43.805891 4425 heartbeater.cc:503] Master 127.19.59.126:36449 was elected leader, sending a full tablet report...
I20260812 00:07:43.805940 4440 tablet_bootstrap.cc:492] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9: No bootstrap required, opened a new log
I20260812 00:07:43.805994 4440 ts_tablet_manager.cc:1397] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:07:43.807364 4440 raft_consensus.cc:348] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } }
I20260812 00:07:43.807469 4440 raft_consensus.cc:374] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:07:43.807487 4440 raft_consensus.cc:729] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adc6e6abc4fa44a386196441ab4040d9, State: Initialized, Role: FOLLOWER
I20260812 00:07:43.807581 4440 consensus_queue.cc:260] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } }
I20260812 00:07:43.807798 4440 ts_tablet_manager.cc:1428] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:07:43.807857 4279 heartbeater.cc:503] Master 127.19.59.126:36449 was elected leader, sending a full tablet report...
I20260812 00:07:43.890033 4443 raft_consensus.cc:482] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:07:43.890158 4443 raft_consensus.cc:504] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } }
I20260812 00:07:43.890758 4443 leader_election.cc:288] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325), 3ba7a4470c364b16b06d7eb60f1f2c46 (127.19.59.65:42775)
I20260812 00:07:43.894085 4281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.890599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:34325 (local address 127.19.59.66:58815)
0812 00:07:43.890646 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:43.890655 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:43.890688 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:43.890927 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:43.890928 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:43.890930 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:07:43.890996 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.890997 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.891872 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.891874 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.892951 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.892953 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.893837 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.893837 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.893916 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.893919 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:07:43.893982 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:07:43.894023 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:07:43.894085 4433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.890674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:58815 (local address 127.19.59.67:34325)
0812 00:07:43.890719 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.890721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.890729 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:07:43.890755 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.890756 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.890766 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.890825 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:07:43.891068 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.891694 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.893033 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.893522 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.893584 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.893591 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.893988 (+ 397us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.894028 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:07:43.894349 4136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.890926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:44967 (local address 127.19.59.65:42775)
0812 00:07:43.890962 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.890964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.891077 (+ 113us) server_negotiation.cc:407] Connection header received
0812 00:07:43.891156 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.891157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.891164 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.891186 (+ 22us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:07:43.891353 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.892008 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.893399 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.893937 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.893989 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.893998 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.894225 (+ 227us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.894273 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:07:43.894384 4373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c3d10fd7e3e48159202ecb1fc40c867" candidate_uuid: "adc6e6abc4fa44a386196441ab4040d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d33d78ccf68d43288fb9fab381705709" is_pre_election: true
I20260812 00:07:43.894538 4373 raft_consensus.cc:2454] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adc6e6abc4fa44a386196441ab4040d9 in term 0.
I20260812 00:07:43.894603 4444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.890886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:42775 (local address 127.19.59.66:44967)
0812 00:07:43.891016 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:43.891024 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:43.891098 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:43.891238 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:43.891239 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:43.891240 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:07:43.891301 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.891302 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.892112 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.892113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.893289 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:43.893292 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.894077 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.894078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:43.894150 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.894153 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:07:43.894465 (+ 312us) client_negotiation.cc:240] Negotiation successful
0812 00:07:43.894506 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":78,"threads_started":1}
I20260812 00:07:43.894850 4156 leader_election.cc:302] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adc6e6abc4fa44a386196441ab4040d9, d33d78ccf68d43288fb9fab381705709; no voters:
I20260812 00:07:43.894973 4443 raft_consensus.cc:2781] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:07:43.895018 4443 raft_consensus.cc:482] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:07:43.895057 4443 raft_consensus.cc:3037] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:07:43.894984 4071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c3d10fd7e3e48159202ecb1fc40c867" candidate_uuid: "adc6e6abc4fa44a386196441ab4040d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" is_pre_election: true
I20260812 00:07:43.895140 4071 raft_consensus.cc:2454] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adc6e6abc4fa44a386196441ab4040d9 in term 0.
I20260812 00:07:43.895864 4443 raft_consensus.cc:504] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } }
I20260812 00:07:43.895994 4443 leader_election.cc:288] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [CANDIDATE]: Term 1 election: Requested vote from peers d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325), 3ba7a4470c364b16b06d7eb60f1f2c46 (127.19.59.65:42775)
I20260812 00:07:43.896155 4373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c3d10fd7e3e48159202ecb1fc40c867" candidate_uuid: "adc6e6abc4fa44a386196441ab4040d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d33d78ccf68d43288fb9fab381705709"
I20260812 00:07:43.896258 4373 raft_consensus.cc:3037] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:07:43.896394 4071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c3d10fd7e3e48159202ecb1fc40c867" candidate_uuid: "adc6e6abc4fa44a386196441ab4040d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46"
I20260812 00:07:43.896528 4071 raft_consensus.cc:3037] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:07:43.897294 4373 raft_consensus.cc:2454] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adc6e6abc4fa44a386196441ab4040d9 in term 1.
I20260812 00:07:43.897449 4156 leader_election.cc:302] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adc6e6abc4fa44a386196441ab4040d9, d33d78ccf68d43288fb9fab381705709; no voters:
I20260812 00:07:43.897511 4071 raft_consensus.cc:2454] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adc6e6abc4fa44a386196441ab4040d9 in term 1.
I20260812 00:07:43.897713 4443 raft_consensus.cc:2781] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:07:43.897890 4443 raft_consensus.cc:686] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [term 1 LEADER]: Becoming Leader. State: Replica: adc6e6abc4fa44a386196441ab4040d9, State: Running, Role: LEADER
I20260812 00:07:43.897984 4443 consensus_queue.cc:237] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } }
I20260812 00:07:43.898799 3913 catalog_manager.cc:5495] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66). New cstate: current_term: 1 leader_uuid: "adc6e6abc4fa44a386196441ab4040d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } health_report { overall_health: UNKNOWN } } }
W20260812 00:07:43.911208 4280 tablet.cc:2369] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:07:43.921634 4434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.918991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46848 (local address 127.19.59.66:33677)
0812 00:07:43.919025 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:43.919027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:43.919065 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:07:43.919178 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:43.919179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:43.919194 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:43.919247 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:07:43.919380 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.919793 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.920810 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:43.921076 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:43.921135 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:43.921307 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:07:43.921411 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:07:43.921481 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:43.921538 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 00:07:43.921556 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 00:07:43.923297 4373 raft_consensus.cc:1261] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709 [term 1 FOLLOWER]: Refusing update from remote peer adc6e6abc4fa44a386196441ab4040d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:07:43.923321 4071 raft_consensus.cc:1261] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Refusing update from remote peer adc6e6abc4fa44a386196441ab4040d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:07:43.923605 4445 consensus_queue.cc:1035] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:07:43.923728 4443 consensus_queue.cc:1035] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:07:43.925679 4448 mvcc.cc:205] Tried to move back new op lower bound from 7317476409027305472 to 7317476408926810112. Current Snapshot: MvccSnapshot[applied={T|T < 7317476409027305472}]
I20260812 00:07:43.926044 4449 mvcc.cc:205] Tried to move back new op lower bound from 7317476409027305472 to 7317476408926810112. Current Snapshot: MvccSnapshot[applied={T|T < 7317476409027305472}]
I20260812 00:07:43.926260 4450 mvcc.cc:205] Tried to move back new op lower bound from 7317476409027305472 to 7317476408926810112. Current Snapshot: MvccSnapshot[applied={T|T < 7317476409027305472}]
I20260812 00:07:43.928032 3912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:56874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:07:43.928124 3912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:56874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:07:43.928788 3912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: Sending DeleteTablet for 3 replicas of tablet 3c3d10fd7e3e48159202ecb1fc40c867
I20260812 00:07:43.929020 4204 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c3d10fd7e3e48159202ecb1fc40c867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:07:43 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:46832
I20260812 00:07:43.929114 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 3960
I20260812 00:07:43.929145 4352 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c3d10fd7e3e48159202ecb1fc40c867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:07:43 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:53718
I20260812 00:07:43.930124 4460 tablet_replica.cc:330] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9: stopping tablet replica
I20260812 00:07:43.930208 4460 raft_consensus.cc:2229] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:07:43.930280 4460 raft_consensus.cc:2258] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:07:43.933022 4204 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c3d10fd7e3e48159202ecb1fc40c867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:07:43 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:46832
I20260812 00:07:43.934504 4460 ts_tablet_manager.cc:1905] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:07:43.936023 4460 ts_tablet_manager.cc:1918] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:07:43.936091 4460 log.cc:1196] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/3c3d10fd7e3e48159202ecb1fc40c867
I20260812 00:07:43.936440 4460 ts_tablet_manager.cc:1939] T 3c3d10fd7e3e48159202ecb1fc40c867 P adc6e6abc4fa44a386196441ab4040d9: Deleting consensus metadata
I20260812 00:07:43.936911 3897 catalog_manager.cc:4841] TS adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66:33677): tablet 3c3d10fd7e3e48159202ecb1fc40c867 (table test-table [id=4e718707e59341da8ca84dd5f9d8c27a]) successfully deleted
W20260812 00:07:43.937251 3897 catalog_manager.cc:4808] TS adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66:33677): delete failed for tablet 3c3d10fd7e3e48159202ecb1fc40c867 because the tablet was not found. No further retry: Not found: Tablet not found: 3c3d10fd7e3e48159202ecb1fc40c867
W20260812 00:07:43.941629 3896 connection.cc:535] client connection to 127.19.59.65:42775 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 00:07:43.941701 3896 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:07:43.942030 4461 tablet_replica.cc:330] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709: stopping tablet replica
I20260812 00:07:43.942152 4461 raft_consensus.cc:2229] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:07:43.942250 4461 raft_consensus.cc:2258] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:07:43.942454 4432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:43.942303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:42775 (local address 127.0.0.1:46822)
0812 00:07:43.942347 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:43.942409 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:42775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260812 00:07:43.942469 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 4130
W20260812 00:07:43.944569 3896 catalog_manager.cc:4584] TS 3ba7a4470c364b16b06d7eb60f1f2c46 (127.19.59.65:42775): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3c3d10fd7e3e48159202ecb1fc40c867: Network error: Client connection negotiation failed: client connection to 127.19.59.65:42775: connect: Connection refused (error 111)
I20260812 00:07:43.945799 4461 ts_tablet_manager.cc:1905] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:07:43.947708 4461 ts_tablet_manager.cc:1918] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:07:43.947772 4461 log.cc:1196] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/3c3d10fd7e3e48159202ecb1fc40c867
I20260812 00:07:43.948057 4461 ts_tablet_manager.cc:1939] T 3c3d10fd7e3e48159202ecb1fc40c867 P d33d78ccf68d43288fb9fab381705709: Deleting consensus metadata
I20260812 00:07:43.948505 3898 catalog_manager.cc:4841] TS d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325): tablet 3c3d10fd7e3e48159202ecb1fc40c867 (table test-table [id=4e718707e59341da8ca84dd5f9d8c27a]) successfully deleted
I20260812 00:07:43.950242 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 4283
I20260812 00:07:43.955924 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 3876
I20260812 00:07:43.962936 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:36449
--webserver_interface=127.19.59.126
--webserver_port=38363
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:36449
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:07:44.039258 4463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:44.039481 4463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:44.039516 4463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:44.040575 4463 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:07:44.040643 4463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:44.040665 4463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:44.040684 4463 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:07:44.040711 4463 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:07:44.041991 4463 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:36449
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:36449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=38363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:44.042228 4463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:44.042438 4463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:44.047232 4471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:44.047350 4469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:44.047228 4468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:44.047554 4463 server_base.cc:1034] running on GCE node
I20260812 00:07:44.047776 4463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:44.048061 4463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:44.049213 4463 hybrid_clock.cc:648] HybridClock initialized: now 1786493264049208 us; error 32 us; skew 500 ppm
Aug 12 00:07:44 dist-test-slave-6nmv krb5kdc[3254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493264, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:44.051544 4463 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:07:44.052014 4463 webserver.cc:460] Webserver started at http://127.19.59.126:38363/ using document root <none> and password file <none>
I20260812 00:07:44.052241 4463 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:44.052310 4463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:44.053655 4463 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:07:44.054371 4478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:44.054574 4463 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:07:44.054667 4463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "ebe6dc62ccf745eaa6d042dfcf045e06"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "9129f5657a80bd28f6495d529c853267"
server_key_iv: "dd436717213c7224ca93203787636ba9"
server_key_version: "encryptionkey@0"
I20260812 00:07:44.054960 4463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:44.067317 4463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:44.068887 4463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:44.069051 4463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:44.072939 4463 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:36449
I20260812 00:07:44.072979 4539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:36449 every 8 connection(s)
I20260812 00:07:44.073326 4463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:07:44.074790 4540 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:07:44.075403 4540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: Bootstrap starting.
I20260812 00:07:44.077991 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 4463
I20260812 00:07:44.078267 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:42775
--local_ip_for_outbound_sockets=127.19.59.65
--tserver_master_addrs=127.19.59.126:36449
--webserver_port=46289
--webserver_interface=127.19.59.65
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:07:44.083679 4540 log.cc:824] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:44.085685 4540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:07:44.086009 4540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06: Bootstrap complete.
I20260812 00:07:44.088049 4540 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } }
I20260812 00:07:44.088240 4540 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6dc62ccf745eaa6d042dfcf045e06, State: Initialized, Role: FOLLOWER
I20260812 00:07:44.088394 4540 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } }
I20260812 00:07:44.088449 4540 raft_consensus.cc:388] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:07:44.088505 4540 raft_consensus.cc:482] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:07:44.088550 4540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 2 FOLLOWER]: Advancing to term 3
I20260812 00:07:44.089540 4540 raft_consensus.cc:504] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } }
I20260812 00:07:44.089660 4540 leader_election.cc:302] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ebe6dc62ccf745eaa6d042dfcf045e06; no voters:
I20260812 00:07:44.089854 4540 leader_election.cc:288] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 00:07:44.089887 4544 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 00:07:44.090000 4544 raft_consensus.cc:686] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [term 3 LEADER]: Becoming Leader. State: Replica: ebe6dc62ccf745eaa6d042dfcf045e06, State: Running, Role: LEADER
I20260812 00:07:44.090083 4544 consensus_queue.cc:237] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } }
I20260812 00:07:44.090118 4540 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:07:44.090366 4544 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebe6dc62ccf745eaa6d042dfcf045e06. Latest consensus state: current_term: 3 leader_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } } }
I20260812 00:07:44.090443 4544 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [sys.catalog]: This master's current role is: LEADER
I20260812 00:07:44.090370 4545 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebe6dc62ccf745eaa6d042dfcf045e06" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36449 } } }
I20260812 00:07:44.090631 4545 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebe6dc62ccf745eaa6d042dfcf045e06 [sys.catalog]: This master's current role is: LEADER
I20260812 00:07:44.090701 4548 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:07:44.091509 4548 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:07:44.091627 4548 catalog_manager.cc:1259] Loaded cluster ID: 3774b1f630ba4fb49ff7cc164cde63f2
I20260812 00:07:44.092051 4548 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 00:07:44.092397 4548 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f7df47c19ad google::LogMessage::Fail() at ??:0
@ 0x7f7df47c488a google::LogMessage::SendToLog() at ??:0
@ 0x7f7df47c14de google::LogMessage::Flush() at ??:0
@ 0x7f7df47c2a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f7dfc6e60f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f7dfc6ef8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f7df668f0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f7df6684954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f7df74e86db start_thread at ??:0
@ 0x7f7df32bf61f clone at ??:0
W20260812 00:07:44.171099 4542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:44.171286 4542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:44.171309 4542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:44.172465 4542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:44.172505 4542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:44.172529 4542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:07:44.173923 4542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:42775
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=46289
--tserver_master_addrs=127.19.59.126:36449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:44.174125 4542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:44.174345 4542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:44.178982 4583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:44.179024 4585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:44.179188 4542 server_base.cc:1034] running on GCE node
W20260812 00:07:44.179137 4587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:44.179481 4542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:44.179728 4542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:44.180898 4542 hybrid_clock.cc:648] HybridClock initialized: now 1786493264180886 us; error 27 us; skew 500 ppm
Aug 12 00:07:44 dist-test-slave-6nmv krb5kdc[3254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493264, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:44.183465 4542 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:07:44.183832 4542 webserver.cc:460] Webserver started at http://127.19.59.65:46289/ using document root <none> and password file <none>
I20260812 00:07:44.184054 4542 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:44.184115 4542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:44.185308 4542 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:07:44.186094 4596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:44.186268 4542 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:07:44.186369 4542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "3ba7a4470c364b16b06d7eb60f1f2c46"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "5404648573ad5ae6dcd711865814ca54"
server_key_iv: "8b4652c2b5315989d4fadc95b2824550"
server_key_version: "encryptionkey@0"
I20260812 00:07:44.186707 4542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:44.195499 4542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:44.197507 4542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:44.197669 4542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:44.197973 4542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:07:44.198376 4604 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 00:07:44.200114 4542 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 00:07:44.200176 4542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 00:07:44.200213 4542 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 00:07:44.200752 4542 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 00:07:44.200806 4542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 00:07:44.200874 4604 tablet_bootstrap.cc:492] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46: Bootstrap starting.
I20260812 00:07:44.207724 4542 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:42775
I20260812 00:07:44.207846 4722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:42775 every 8 connection(s)
I20260812 00:07:44.208087 4542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:07:44.212224 4604 log.cc:824] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46: Log is configured to *not* fsync() on all Append() calls
I20260812 00:07:44.214977 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 4542
I20260812 00:07:44.215099 4604 tablet_bootstrap.cc:492] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:07:44.215363 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:33677
--local_ip_for_outbound_sockets=127.19.59.66
--tserver_master_addrs=127.19.59.126:36449
--webserver_port=46855
--webserver_interface=127.19.59.66
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:07:44.215514 4604 tablet_bootstrap.cc:492] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46: Bootstrap complete.
I20260812 00:07:44.216825 4604 ts_tablet_manager.cc:1397] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.009s
I20260812 00:07:44.218243 4604 raft_consensus.cc:348] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } }
I20260812 00:07:44.218575 4604 raft_consensus.cc:729] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba7a4470c364b16b06d7eb60f1f2c46, State: Initialized, Role: FOLLOWER
I20260812 00:07:44.218746 4604 consensus_queue.cc:260] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } }
I20260812 00:07:44.219020 4604 ts_tablet_manager.cc:1428] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
W20260812 00:07:44.265270 4726 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:07:44.208844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:38549)
0812 00:07:44.209030 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:44.209062 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:44.209453 (+ 391us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:44.265092 (+ 55639us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":105,"threads_started":1}
W20260812 00:07:44.265529 4723 heartbeater.cc:644] Failed to heartbeat to 127.19.59.126:36449 (0 consecutive failures): Network error: Failed to ping master at 127.19.59.126:36449: Client connection negotiation failed: client connection to 127.19.59.126:36449: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:07:44.265961 4726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:44.265775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:58397)
0812 00:07:44.265863 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:44.265921 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 00:07:44.266346 4726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:44.266232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:53345)
0812 00:07:44.266287 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:44.266319 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 00:07:44.266480 4723 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:07:44.293013 4728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:44.293186 4728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:44.293206 4728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:44.294512 4728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:44.294556 4728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:44.294591 4728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:07:44.295970 4728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:33677
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=46855
--tserver_master_addrs=127.19.59.126:36449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:44.296207 4728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:44.296438 4728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:07:44.300810 4728 server_base.cc:1034] running on GCE node
W20260812 00:07:44.300763 4739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:44.300756 4737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:44.300776 4736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:44.301156 4728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:44.301366 4728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:44.302501 4728 hybrid_clock.cc:648] HybridClock initialized: now 1786493264302489 us; error 28 us; skew 500 ppm
Aug 12 00:07:44 dist-test-slave-6nmv krb5kdc[3254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493264, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:44.304628 4728 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:07:44.305006 4728 webserver.cc:460] Webserver started at http://127.19.59.66:46855/ using document root <none> and password file <none>
I20260812 00:07:44.305220 4728 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:44.305284 4728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:44.306599 4728 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:07:44.307166 4747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:44.307317 4728 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:07:44.307415 4728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "adc6e6abc4fa44a386196441ab4040d9"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "3cd244e9aac0156fa5849a9205ab1f28"
server_key_iv: "98cc2511fbe6a8e2c56aad319149b0df"
server_key_version: "encryptionkey@0"
I20260812 00:07:44.307705 4728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:44.323513 4728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:44.325088 4728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:44.325228 4728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:44.325464 4728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:07:44.325758 4728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:07:44.325814 4728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:44.325901 4728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:07:44.325933 4728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:44.331674 4728 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:33677
I20260812 00:07:44.331717 4874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:33677 every 8 connection(s)
I20260812 00:07:44.332050 4728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:07:44.332376 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 4728
I20260812 00:07:44.332652 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:34325
--local_ip_for_outbound_sockets=127.19.59.67
--tserver_master_addrs=127.19.59.126:36449
--webserver_port=44305
--webserver_interface=127.19.59.67
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:33329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:07:44.333143 4877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:44.332757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:50469)
0812 00:07:44.332927 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:44.333013 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":95,"threads_started":1}
W20260812 00:07:44.333479 4875 heartbeater.cc:644] Failed to heartbeat to 127.19.59.126:36449 (0 consecutive failures): Network error: Failed to ping master at 127.19.59.126:36449: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
I20260812 00:07:44.333763 4877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:44.333649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:40341)
0812 00:07:44.333715 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:44.333745 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 00:07:44.334082 4877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:44.333987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:57351)
0812 00:07:44.334030 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:44.334066 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 00:07:44.334179 4875 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:07:44.406599 4878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:07:44.406855 4878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:07:44.406893 4878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:07:44.408674 4878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:07:44.408733 4878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:07:44.408776 4878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:07:44.410790 4878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:33329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:34325
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=44305
--tserver_master_addrs=127.19.59.126:36449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:07:44.411149 4878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:07:44.411409 4878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:07:44.417060 4883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:44.417119 4888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:07:44.417038 4885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:07:44.417291 4878 server_base.cc:1034] running on GCE node
I20260812 00:07:44.417436 4878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:07:44.417644 4878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:07:44.418813 4878 hybrid_clock.cc:648] HybridClock initialized: now 1786493264418785 us; error 43 us; skew 500 ppm
Aug 12 00:07:44 dist-test-slave-6nmv krb5kdc[3254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493264, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:07:44.421101 4878 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:07:44.421479 4878 webserver.cc:460] Webserver started at http://127.19.59.67:44305/ using document root <none> and password file <none>
I20260812 00:07:44.421674 4878 fs_manager.cc:359] Metadata directory not provided
I20260812 00:07:44.421734 4878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:07:44.422847 4878 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:07:44.423350 4895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:44.423501 4878 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:07:44.423614 4878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "d33d78ccf68d43288fb9fab381705709"
format_stamp: "Formatted at 2026-08-12 00:07:42 on dist-test-slave-6nmv"
server_key: "ed4a0db9770c08e30654a76535d6ccd0"
server_key_iv: "429a3da5d60215313c1c5b1c56021723"
server_key_version: "encryptionkey@0"
I20260812 00:07:44.423900 4878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:07:44.431000 4878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:07:44.432523 4878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:07:44.432672 4878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:07:44.432873 4878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:07:44.433118 4878 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:07:44.433174 4878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:44.433202 4878 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:07:44.433226 4878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:07:44.438479 4878 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:34325
I20260812 00:07:44.438510 5025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:34325 every 8 connection(s)
I20260812 00:07:44.438793 4878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:07:44.439646 5028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:44.439340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:33003)
0812 00:07:44.439464 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:44.439522 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":62,"threads_started":1}
W20260812 00:07:44.439965 5026 heartbeater.cc:644] Failed to heartbeat to 127.19.59.126:36449 (0 consecutive failures): Network error: Failed to ping master at 127.19.59.126:36449: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
I20260812 00:07:44.440186 5028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:44.440107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:56397)
0812 00:07:44.440147 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:44.440170 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 00:07:44.440394 5028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:44.440351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:51925)
0812 00:07:44.440369 (+ 18us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:44.440384 (+ 15us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10}
W20260812 00:07:44.440471 5026 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:07:44.448163 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 4878
I20260812 00:07:45.267069 5030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:45.266851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:43859)
0812 00:07:45.266971 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:45.267002 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":57,"threads_started":1}
I20260812 00:07:45.334646 5031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:45.334460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:55937)
0812 00:07:45.334573 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:45.334605 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":51,"threads_started":1}
I20260812 00:07:45.440994 5032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:45.440818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:52937)
0812 00:07:45.440927 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:45.440954 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":54,"threads_started":1}
I20260812 00:07:45.785055 5034 raft_consensus.cc:482] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:07:45.785169 5034 raft_consensus.cc:504] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } }
I20260812 00:07:45.785454 5034 leader_election.cc:288] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325), adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66:33677)
Aug 12 00:07:45 dist-test-slave-6nmv krb5kdc[3254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493264, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.67@KRBTEST.COM
Aug 12 00:07:45 dist-test-slave-6nmv krb5kdc[3254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493264, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.66@KRBTEST.COM
I20260812 00:07:45.795560 5037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:45.785713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:37959 (local address 127.19.59.67:34325)
0812 00:07:45.785887 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:45.785899 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:45.785935 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:07:45.786440 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:45.786442 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:45.786481 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:45.786630 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:45.787326 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:45.788060 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:45.789079 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:45.789475 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:45.789585 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:45.791872 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:45.791875 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:45.791875 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:45.791885 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:45.793755 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:45.794223 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:45.794225 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:45.794226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:45.794343 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:45.794627 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:45.794628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:45.794628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:45.794900 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:45.794979 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:45.795307 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 00:07:45.795430 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":48,"threads_started":1}
I20260812 00:07:45.795555 5038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:45.785795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:34521 (local address 127.19.59.66:33677)
0812 00:07:45.785971 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 00:07:45.785980 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:07:45.786007 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:07:45.786436 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:07:45.786437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:07:45.786483 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:07:45.786631 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:07:45.787322 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:45.788053 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:45.789044 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:07:45.789476 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:07:45.789600 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:45.792273 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:07:45.792276 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:07:45.792277 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:07:45.792285 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:07:45.793963 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:45.794293 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:45.794295 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:45.794296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:45.794380 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:07:45.794626 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:07:45.794627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:07:45.794627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:07:45.794899 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:07:45.794979 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 00:07:45.795307 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 00:07:45.795430 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":76,"threads_started":1}
I20260812 00:07:45.795550 5036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:45.785611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:34325 (local address 127.19.59.65:37959)
0812 00:07:45.785752 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:45.785765 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:45.785824 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:45.786675 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:45.786678 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:45.787037 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:45.787213 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:45.787218 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:45.788193 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:45.788194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:45.788957 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:45.788986 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:45.789564 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:45.789565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:45.789696 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:45.790356 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:45.790362 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:45.791758 (+ 1396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:45.793868 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:45.793873 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:45.793875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:45.794148 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:45.794422 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:45.794422 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:45.794423 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:45.794558 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:45.794972 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:45.794978 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:45.795129 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 00:07:45.795236 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 00:07:45.795412 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":35,"thread_start_us":98,"threads_started":1}
I20260812 00:07:45.795641 5035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:45.785617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:33677 (local address 127.19.59.65:34521)
0812 00:07:45.785753 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:45.785765 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:07:45.785853 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:07:45.786675 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:07:45.786678 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:07:45.787036 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:07:45.787213 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:45.787218 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:45.788303 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:45.788304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:45.788956 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:07:45.788958 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:07:45.789583 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:07:45.789584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:07:45.789695 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:07:45.790290 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:07:45.790298 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:07:45.792152 (+ 1854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:07:45.794024 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:45.794025 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:45.794025 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:45.794226 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:45.794438 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:07:45.794438 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:07:45.794438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:07:45.794558 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:07:45.794972 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:07:45.794978 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:07:45.795129 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 00:07:45.795236 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 00:07:45.795462 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":107,"thread_start_us":76,"threads_started":1}
W20260812 00:07:45.796362 4598 leader_election.cc:341] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66:33677): Not found: Tablet not found: 3c3d10fd7e3e48159202ecb1fc40c867
W20260812 00:07:45.796865 4599 leader_election.cc:341] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325): Not found: Tablet not found: 3c3d10fd7e3e48159202ecb1fc40c867
I20260812 00:07:45.796919 4599 leader_election.cc:302] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ba7a4470c364b16b06d7eb60f1f2c46; no voters: adc6e6abc4fa44a386196441ab4040d9, d33d78ccf68d43288fb9fab381705709
I20260812 00:07:45.797008 5034 raft_consensus.cc:2726] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:07:46.267683 5035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:46.267568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:50005)
0812 00:07:46.267613 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:46.267644 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:07:46.335245 5040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:46.335067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:55035)
0812 00:07:46.335179 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:46.335212 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":71,"threads_started":1}
I20260812 00:07:46.441617 5041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:46.441357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:47807)
0812 00:07:46.441547 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:46.441581 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":57,"threads_started":1}
I20260812 00:07:47.268364 5042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:47.268148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:39939)
0812 00:07:47.268289 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:47.268320 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":78,"threads_started":1}
I20260812 00:07:47.335842 5043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:47.335622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:51729)
0812 00:07:47.335775 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:47.335806 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":93,"threads_started":1}
I20260812 00:07:47.442263 5044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:47.442087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:50843)
0812 00:07:47.442198 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:47.442229 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":54,"threads_started":1}
I20260812 00:07:47.862265 5045 raft_consensus.cc:482] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:07:47.862381 5045 raft_consensus.cc:504] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } }
I20260812 00:07:47.862592 5045 leader_election.cc:288] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325), adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66:33677)
W20260812 00:07:47.863030 4598 leader_election.cc:341] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66:33677): Not found: Tablet not found: 3c3d10fd7e3e48159202ecb1fc40c867
W20260812 00:07:47.863116 4599 leader_election.cc:341] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325): Not found: Tablet not found: 3c3d10fd7e3e48159202ecb1fc40c867
I20260812 00:07:47.863195 4599 leader_election.cc:302] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ba7a4470c364b16b06d7eb60f1f2c46; no voters: adc6e6abc4fa44a386196441ab4040d9, d33d78ccf68d43288fb9fab381705709
I20260812 00:07:47.863279 5045 raft_consensus.cc:2726] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:07:48.268994 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:48.268773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:44847)
0812 00:07:48.268891 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:48.268925 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260812 00:07:48.336417 5047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:48.336236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:43081)
0812 00:07:48.336350 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:48.336383 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":56,"threads_started":1}
I20260812 00:07:48.442829 5048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:48.442653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:33921)
0812 00:07:48.442760 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:48.442793 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":53,"threads_started":1}
I20260812 00:07:49.269753 5050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:49.269565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:49557)
0812 00:07:49.269680 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:49.269710 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":55,"threads_started":1}
I20260812 00:07:49.337188 5051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:49.336981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:46757)
0812 00:07:49.337124 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:49.337156 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":93,"threads_started":1}
I20260812 00:07:49.443343 5052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:49.443185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:49287)
0812 00:07:49.443288 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:49.443314 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":59,"threads_started":1}
I20260812 00:07:49.741501 5053 raft_consensus.cc:482] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:07:49.741614 5053 raft_consensus.cc:504] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } }
I20260812 00:07:49.741835 5053 leader_election.cc:288] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325), adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66:33677)
W20260812 00:07:49.742159 4599 leader_election.cc:341] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325): Not found: Tablet not found: 3c3d10fd7e3e48159202ecb1fc40c867
W20260812 00:07:49.742237 4598 leader_election.cc:341] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66:33677): Not found: Tablet not found: 3c3d10fd7e3e48159202ecb1fc40c867
I20260812 00:07:49.742297 4598 leader_election.cc:302] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ba7a4470c364b16b06d7eb60f1f2c46; no voters: adc6e6abc4fa44a386196441ab4040d9, d33d78ccf68d43288fb9fab381705709
I20260812 00:07:49.742357 5053 raft_consensus.cc:2726] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:07:50.270428 5054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:50.270187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:51513)
0812 00:07:50.270335 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:50.270372 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":76,"threads_started":1}
I20260812 00:07:50.337846 5055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:50.337587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:48153)
0812 00:07:50.337729 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:50.337766 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":76,"threads_started":1}
I20260812 00:07:50.443965 5056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:50.443744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:53669)
0812 00:07:50.443893 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:50.443926 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":94,"threads_started":1}
I20260812 00:07:51.271136 5057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:51.270940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:40253)
0812 00:07:51.271067 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:51.271096 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":77,"threads_started":1}
I20260812 00:07:51.338487 5058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:51.338281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:43665)
0812 00:07:51.338417 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:51.338451 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":73,"threads_started":1}
I20260812 00:07:51.444588 5059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:51.444401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:39931)
0812 00:07:51.444518 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:51.444552 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260812 00:07:52.271787 5060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:52.271559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:43249)
0812 00:07:52.271698 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:52.271741 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":67,"threads_started":1}
I20260812 00:07:52.339057 5061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:52.338865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:35215)
0812 00:07:52.338980 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:52.339012 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":55,"threads_started":1}
I20260812 00:07:52.445408 5062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:52.445103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:37219)
0812 00:07:52.445337 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:52.445372 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":55,"threads_started":1}
I20260812 00:07:53.272544 5063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:53.272314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:56611)
0812 00:07:53.272462 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:53.272498 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":64,"threads_started":1}
I20260812 00:07:53.339661 5064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:53.339451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:39969)
0812 00:07:53.339593 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:53.339625 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":60,"threads_started":1}
I20260812 00:07:53.446074 5065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:53.445873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:50537)
0812 00:07:53.446006 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:53.446038 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":77,"threads_started":1}
I20260812 00:07:53.614161 5066 raft_consensus.cc:482] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:07:53.614259 5066 raft_consensus.cc:504] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d33d78ccf68d43288fb9fab381705709" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 34325 } } peers { permanent_uuid: "adc6e6abc4fa44a386196441ab4040d9" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 33677 } } peers { permanent_uuid: "3ba7a4470c364b16b06d7eb60f1f2c46" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42775 } }
I20260812 00:07:53.614459 5066 leader_election.cc:288] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325), adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66:33677)
W20260812 00:07:53.614828 4598 leader_election.cc:341] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer adc6e6abc4fa44a386196441ab4040d9 (127.19.59.66:33677): Not found: Tablet not found: 3c3d10fd7e3e48159202ecb1fc40c867
W20260812 00:07:53.614931 4599 leader_election.cc:341] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d33d78ccf68d43288fb9fab381705709 (127.19.59.67:34325): Not found: Tablet not found: 3c3d10fd7e3e48159202ecb1fc40c867
I20260812 00:07:53.614988 4599 leader_election.cc:302] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ba7a4470c364b16b06d7eb60f1f2c46; no voters: adc6e6abc4fa44a386196441ab4040d9, d33d78ccf68d43288fb9fab381705709
I20260812 00:07:53.615067 5066 raft_consensus.cc:2726] T 3c3d10fd7e3e48159202ecb1fc40c867 P 3ba7a4470c364b16b06d7eb60f1f2c46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:07:54.273274 5067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:54.272983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:48479)
0812 00:07:54.273192 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:54.273227 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":59,"threads_started":1}
I20260812 00:07:54.340274 5068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:54.340064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:56825)
0812 00:07:54.340187 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:54.340234 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":60,"threads_started":1}
I20260812 00:07:54.446691 5069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:54.446515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:47403)
0812 00:07:54.446619 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:54.446652 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":51,"threads_started":1}
I20260812 00:07:55.274058 5070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:55.273821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:58653)
0812 00:07:55.273974 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:55.274004 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":103,"threads_started":1}
I20260812 00:07:55.340912 5071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:55.340733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:34901)
0812 00:07:55.340854 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:55.340881 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":74,"threads_started":1}
I20260812 00:07:55.447259 5072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:55.447070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:52475)
0812 00:07:55.447194 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:55.447227 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":60,"threads_started":1}
I20260812 00:07:56.274710 5073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:56.274455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:53149)
0812 00:07:56.274619 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:56.274650 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":81,"threads_started":1}
I20260812 00:07:56.341476 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:56.341298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:33933)
0812 00:07:56.341411 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:56.341440 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":60,"threads_started":1}
I20260812 00:07:56.447912 5076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:56.447717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:43911)
0812 00:07:56.447850 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:56.447880 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
I20260812 00:07:57.275350 5077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:57.275143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:51741)
0812 00:07:57.275269 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:57.275304 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":59,"threads_started":1}
I20260812 00:07:57.342149 5078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:57.341946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:42625)
0812 00:07:57.342082 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:57.342115 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":75,"threads_started":1}
I20260812 00:07:57.448522 5079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:57.448341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:57415)
0812 00:07:57.448460 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:57.448490 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":69,"threads_started":1}
I20260812 00:07:58.275982 5080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:58.275746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:36901)
0812 00:07:58.275902 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:58.275936 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":76,"threads_started":1}
I20260812 00:07:58.342741 5081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:58.342559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:50259)
0812 00:07:58.342674 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:58.342705 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
I20260812 00:07:58.449105 5082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:58.448910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:56709)
0812 00:07:58.449038 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:58.449065 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":77,"threads_started":1}
I20260812 00:07:59.277158 5084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:59.276786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.65:52369)
0812 00:07:59.277025 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:59.277080 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":129,"threads_started":1}
I20260812 00:07:59.343550 5085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:59.343285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.66:59515)
0812 00:07:59.343439 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:59.343470 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":75,"threads_started":1}
I20260812 00:07:59.448741 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 4542
I20260812 00:07:59.459221 5086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:07:59.458664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:36449 (local address 127.19.59.67:42403)
0812 00:07:59.459085 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0812 00:07:59.459143 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":341,"threads_started":1}
I20260812 00:07:59.464411 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 4728
I20260812 00:07:59.477200 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 4878
2026-08-12T00:07:59Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18250 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:07:59 dist-test-slave-6nmv krb5kdc[5089](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:07:59 dist-test-slave-6nmv krb5kdc[5089](info): set up 2 sockets
Aug 12 00:07:59 dist-test-slave-6nmv krb5kdc[5089](info): commencing operation
krb5kdc: starting...
W20260812 00:08:00.854547 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.351s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:08:00 dist-test-slave-6nmv krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:08:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:08:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:08:00.971041 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:42229
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:42229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:08:01.051421 5103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:01.051643 5103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:01.051702 5103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:01.052855 5103 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 00:08:01.052932 5103 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 00:08:01.052953 5103 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 00:08:01.052970 5103 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:08:01.052999 5103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:01.053027 5103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:01.053051 5103 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:08:01.053081 5103 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:08:01.054627 5103 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:42229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:42229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:01.054901 5103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:01.055127 5103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:01.060240 5108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:01.060259 5109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:01.060371 5103 server_base.cc:1034] running on GCE node
W20260812 00:08:01.060231 5111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:01.060662 5103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:01.060961 5103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:01.062111 5103 hybrid_clock.cc:648] HybridClock initialized: now 1786493281062090 us; error 38 us; skew 500 ppm
Aug 12 00:08:01 dist-test-slave-6nmv krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493281, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:01.064779 5103 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:08:01.065243 5103 webserver.cc:460] Webserver started at http://127.19.59.126:42521/ using document root <none> and password file <none>
I20260812 00:08:01.065521 5103 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:01.065565 5103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:01.065708 5103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:08:01.066756 5103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "e819e9b0e8ec4d08a24bd35cca794fcd"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "98c39fbb6deb58053d037b63d6595a0b"
server_key_iv: "6de1cdbd6d998b7874e4ede9f0fdc587"
server_key_version: "encryptionkey@0"
I20260812 00:08:01.067114 5103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "e819e9b0e8ec4d08a24bd35cca794fcd"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "98c39fbb6deb58053d037b63d6595a0b"
server_key_iv: "6de1cdbd6d998b7874e4ede9f0fdc587"
server_key_version: "encryptionkey@0"
I20260812 00:08:01.068418 5103 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:08:01.069047 5119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:01.069228 5103 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:08:01.069316 5103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "e819e9b0e8ec4d08a24bd35cca794fcd"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "98c39fbb6deb58053d037b63d6595a0b"
server_key_iv: "6de1cdbd6d998b7874e4ede9f0fdc587"
server_key_version: "encryptionkey@0"
I20260812 00:08:01.069403 5103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:01.093612 5103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:01.095611 5103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:01.095772 5103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:01.099943 5103 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:42229
I20260812 00:08:01.100018 5177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:42229 every 8 connection(s)
I20260812 00:08:01.100334 5103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:08:01.101192 5178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:08:01.103492 5178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Bootstrap starting.
I20260812 00:08:01.104045 5178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Neither blocks nor log segments found. Creating new log.
I20260812 00:08:01.104296 5178 log.cc:824] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Log is configured to *not* fsync() on all Append() calls
I20260812 00:08:01.104902 5178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: No bootstrap required, opened a new log
I20260812 00:08:01.106068 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 5103
I20260812 00:08:01.106185 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:08:01.106405 19693 external_mini_cluster.cc:1428] Setting key b2e9b59147c1722f17295149fc737021
I20260812 00:08:01.106833 5178 raft_consensus.cc:348] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } }
I20260812 00:08:01.107059 5178 raft_consensus.cc:374] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:08:01.107170 5178 raft_consensus.cc:729] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e819e9b0e8ec4d08a24bd35cca794fcd, State: Initialized, Role: FOLLOWER
I20260812 00:08:01.107317 5178 consensus_queue.cc:260] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } }
I20260812 00:08:01.107398 5178 raft_consensus.cc:388] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:08:01.107422 5178 raft_consensus.cc:482] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:08:01.107489 5178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:08:01.108285 5178 raft_consensus.cc:504] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } }
I20260812 00:08:01.108366 5178 leader_election.cc:302] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e819e9b0e8ec4d08a24bd35cca794fcd; no voters:
I20260812 00:08:01.108531 5178 leader_election.cc:288] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:08:01.108561 5184 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:08:01.108670 5184 raft_consensus.cc:686] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 1 LEADER]: Becoming Leader. State: Replica: e819e9b0e8ec4d08a24bd35cca794fcd, State: Running, Role: LEADER
I20260812 00:08:01.108790 5178 sys_catalog.cc:564] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:08:01.108798 5184 consensus_queue.cc:237] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } }
I20260812 00:08:01.109211 5186 sys_catalog.cc:455] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader e819e9b0e8ec4d08a24bd35cca794fcd. Latest consensus state: current_term: 1 leader_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } } }
I20260812 00:08:01.109292 5186 sys_catalog.cc:458] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [sys.catalog]: This master's current role is: LEADER
I20260812 00:08:01.109688 5185 sys_catalog.cc:455] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } } }
I20260812 00:08:01.109755 5185 sys_catalog.cc:458] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [sys.catalog]: This master's current role is: LEADER
I20260812 00:08:01.109951 5192 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:08:01.110438 5192 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:08:01.112105 5192 catalog_manager.cc:1347] Generated new cluster ID: 3f5782a0d6844fdfbfda3bb6c7e7eb93
I20260812 00:08:01.112161 5192 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:08:01 dist-test-slave-6nmv krb5kdc[5089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:08:01.117702 5183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.106929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37550 (local address 127.19.59.126:42229)
0812 00:08:01.107212 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:01.107223 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:01.107256 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:08:01.107408 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:01.107415 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:01.107472 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:01.107613 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:01.108260 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.109485 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.110511 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.111086 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.111193 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.114095 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:01.114105 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:01.114105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:01.114117 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:01.116028 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:01.116425 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:01.116427 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:01.116428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:01.116561 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:01.116781 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:01.116781 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:01.116782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:01.117096 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:01.117221 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:01.117382 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 00:08:01.117512 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":121,"threads_started":1}
I20260812 00:08:01.138638 5192 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:08:01.139344 5192 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:08:01.143360 5192 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Generated new TSK 0
I20260812 00:08:01.143525 5192 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:08:01.174454 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:42229
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:08:01.252961 5208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:01.253135 5208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:01.253155 5208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:01.254065 5208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:01.254094 5208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:01.254123 5208 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:08:01.255337 5208 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5208
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:01.255498 5208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:01.255648 5208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:01.260286 5216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:01.260295 5213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:01.260300 5214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:01.260315 5208 server_base.cc:1034] running on GCE node
I20260812 00:08:01.260632 5208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:01.260852 5208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:01.262003 5208 hybrid_clock.cc:648] HybridClock initialized: now 1786493281261986 us; error 33 us; skew 500 ppm
Aug 12 00:08:01 dist-test-slave-6nmv krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493281, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:01.264268 5208 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:08:01.264693 5208 webserver.cc:460] Webserver started at http://127.19.59.65:33075/ using document root <none> and password file <none>
I20260812 00:08:01.264905 5208 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:01.264945 5208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:01.265089 5208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:08:01.266167 5208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "833d725c7b98480083a29f052bd1a835"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "2f912997dd79c0ca9c3d7c2319b94465"
server_key_iv: "91f6f7deb39da151a3d36a2e81068f98"
server_key_version: "encryptionkey@0"
I20260812 00:08:01.266489 5208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "833d725c7b98480083a29f052bd1a835"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "2f912997dd79c0ca9c3d7c2319b94465"
server_key_iv: "91f6f7deb39da151a3d36a2e81068f98"
server_key_version: "encryptionkey@0"
I20260812 00:08:01.267746 5208 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:08:01.268443 5223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:01.268613 5208 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:08:01.268688 5208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "833d725c7b98480083a29f052bd1a835"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "2f912997dd79c0ca9c3d7c2319b94465"
server_key_iv: "91f6f7deb39da151a3d36a2e81068f98"
server_key_version: "encryptionkey@0"
I20260812 00:08:01.268736 5208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:01.280385 5208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:01.282451 5208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:01.282573 5208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:01.282733 5208 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:08:01.283005 5208 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:08:01.283036 5208 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:01.283053 5208 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:08:01.283095 5208 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:01.288477 5208 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:46479
I20260812 00:08:01.288576 5351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:46479 every 8 connection(s)
I20260812 00:08:01.288810 5208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:08:01.289225 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 5208
I20260812 00:08:01.289340 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:08:01.289558 19693 external_mini_cluster.cc:1428] Setting key 05bb03bdf753eae0b617560933936e4f
Aug 12 00:08:01 dist-test-slave-6nmv krb5kdc[5089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493281, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
I20260812 00:08:01.298303 5183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.289448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:51163 (local address 127.19.59.126:42229)
0812 00:08:01.289485 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:01.289487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:01.289758 (+ 271us) server_negotiation.cc:407] Connection header received
0812 00:08:01.290320 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:01.290321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:01.290332 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:01.290367 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:01.291581 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.292201 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.293184 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.293397 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.293476 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.295493 (+ 2017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:01.295494 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:01.295495 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:01.295502 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:01.296838 (+ 1336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:01.297263 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:01.297264 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:01.297264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:01.297330 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:01.297590 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:01.297591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:01.297591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:01.297715 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:01.297788 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:01.298094 (+ 306us) server_negotiation.cc:299] Negotiation successful
0812 00:08:01.298197 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 00:08:01.298484 5355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.289459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:51163)
0812 00:08:01.289638 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:01.289680 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:01.290212 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:01.290432 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:01.290436 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:01.291226 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:08:01.291493 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.291499 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.292310 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.292311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.293069 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.293071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.293483 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.293484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.293625 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.294084 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:08:01.294092 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:08:01.295396 (+ 1304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:08:01.296925 (+ 1529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:01.296932 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:01.296934 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:01.297181 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:01.297409 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:01.297409 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:01.297410 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:01.297515 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:01.297792 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:08:01.297799 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:08:01.297959 (+ 160us) client_negotiation.cc:769] Sending connection context
0812 00:08:01.298068 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 00:08:01.298250 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
I20260812 00:08:01.298919 5352 heartbeater.cc:347] Connected to a master server at 127.19.59.126:42229
I20260812 00:08:01.299019 5352 heartbeater.cc:464] Registering TS with master...
I20260812 00:08:01.299180 5352 heartbeater.cc:511] Master 127.19.59.126:42229 requested a full tablet report, sending...
I20260812 00:08:01.299656 5137 ts_manager.cc:194] Registered new tserver with Master: 833d725c7b98480083a29f052bd1a835 (127.19.59.65:46479)
I20260812 00:08:01.300172 5137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:51163
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:08:01.315675 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:42229
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:08:01.389436 5358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:01.389592 5358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:01.389611 5358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:01.390663 5358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:01.390719 5358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:01.390743 5358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:08:01.392087 5358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:01.392253 5358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:01.392436 5358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:01.397276 5364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:01.397287 5366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:01.397287 5363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:01.397367 5358 server_base.cc:1034] running on GCE node
I20260812 00:08:01.397716 5358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:01.397974 5358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:01.399142 5358 hybrid_clock.cc:648] HybridClock initialized: now 1786493281399122 us; error 31 us; skew 500 ppm
Aug 12 00:08:01 dist-test-slave-6nmv krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493281, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:01.401489 5358 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:08:01.401942 5358 webserver.cc:460] Webserver started at http://127.19.59.66:37871/ using document root <none> and password file <none>
I20260812 00:08:01.402151 5358 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:01.402215 5358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:01.402359 5358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:08:01.403270 5358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "a6712243f72c412eaee65f27c24dfdc8"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "f3e02c1953a3c29377853d01b1f27343"
server_key_iv: "f0d4c8606f5f8b1d45762d5e8d5738ec"
server_key_version: "encryptionkey@0"
I20260812 00:08:01.403633 5358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "a6712243f72c412eaee65f27c24dfdc8"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "f3e02c1953a3c29377853d01b1f27343"
server_key_iv: "f0d4c8606f5f8b1d45762d5e8d5738ec"
server_key_version: "encryptionkey@0"
I20260812 00:08:01.404980 5358 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:08:01.405659 5374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:01.405879 5358 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:08:01.405974 5358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "a6712243f72c412eaee65f27c24dfdc8"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "f3e02c1953a3c29377853d01b1f27343"
server_key_iv: "f0d4c8606f5f8b1d45762d5e8d5738ec"
server_key_version: "encryptionkey@0"
I20260812 00:08:01.406054 5358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:01.416759 5358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:01.418526 5358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:01.418678 5358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:01.418946 5358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:08:01.419253 5358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:08:01.419309 5358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:01.419344 5358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:08:01.419371 5358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:01.424986 5358 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:42777
I20260812 00:08:01.425035 5500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:42777 every 8 connection(s)
I20260812 00:08:01.425298 5358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:08:01.430332 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 5358
I20260812 00:08:01.430436 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
Aug 12 00:08:01 dist-test-slave-6nmv krb5kdc[5089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493281, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:08:01.430625 19693 external_mini_cluster.cc:1428] Setting key d9ca06337989e8b95daf172b9bd85969
I20260812 00:08:01.433687 5183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.425957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:44759 (local address 127.19.59.126:42229)
0812 00:08:01.426026 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:01.426029 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:01.426181 (+ 152us) server_negotiation.cc:407] Connection header received
0812 00:08:01.426541 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:01.426542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:01.426551 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:01.426596 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:01.427392 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.427874 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.428747 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.428899 (+ 152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.428942 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.430909 (+ 1967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:01.430910 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:01.430911 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:01.430918 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:01.432362 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:01.432775 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:01.432776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:01.432776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:01.432850 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:01.433100 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:01.433101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:01.433101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:01.433206 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:01.433275 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:01.433513 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 00:08:01.433606 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:08:01.433796 5503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.425930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:44759)
0812 00:08:01.426083 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:01.426113 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:01.426474 (+ 361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:01.426637 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:01.426640 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:01.427155 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:08:01.427320 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.427325 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.427952 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.427953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.428683 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.428685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.428962 (+ 277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.428962 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.429050 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.429436 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:08:01.429443 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:08:01.430822 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:08:01.432463 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:01.432470 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:01.432472 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:01.432687 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:01.432921 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:01.432922 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:01.432922 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:01.433032 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:01.433266 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:08:01.433273 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:08:01.433393 (+ 120us) client_negotiation.cc:769] Sending connection context
0812 00:08:01.433482 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 00:08:01.433611 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
I20260812 00:08:01.434186 5501 heartbeater.cc:347] Connected to a master server at 127.19.59.126:42229
I20260812 00:08:01.434274 5501 heartbeater.cc:464] Registering TS with master...
I20260812 00:08:01.434453 5501 heartbeater.cc:511] Master 127.19.59.126:42229 requested a full tablet report, sending...
I20260812 00:08:01.434856 5137 ts_manager.cc:194] Registered new tserver with Master: a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777)
I20260812 00:08:01.435225 5137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:44759
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:08:01.454622 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:42229
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:08:01.529423 5508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:01.529598 5508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:01.529619 5508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:01.530581 5508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:01.530614 5508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:01.530637 5508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:08:01.531817 5508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:01.531975 5508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:01.532116 5508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:01.536517 5516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:01.536497 5514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:01.536619 5508 server_base.cc:1034] running on GCE node
W20260812 00:08:01.536504 5513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:01.536857 5508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:01.537122 5508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:01.538285 5508 hybrid_clock.cc:648] HybridClock initialized: now 1786493281538271 us; error 26 us; skew 500 ppm
Aug 12 00:08:01 dist-test-slave-6nmv krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493281, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:01.540565 5508 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:08:01.541045 5508 webserver.cc:460] Webserver started at http://127.19.59.67:43085/ using document root <none> and password file <none>
I20260812 00:08:01.541247 5508 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:01.541307 5508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:01.541426 5508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:08:01.542400 5508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "0bdafff29ea94319800dd5742e29923d"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "0faf8bb225875aa4fd0bb79fac87aad4"
server_key_iv: "fff0259eb0f54d5fb96952d2b2019211"
server_key_version: "encryptionkey@0"
I20260812 00:08:01.542732 5508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "0bdafff29ea94319800dd5742e29923d"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "0faf8bb225875aa4fd0bb79fac87aad4"
server_key_iv: "fff0259eb0f54d5fb96952d2b2019211"
server_key_version: "encryptionkey@0"
I20260812 00:08:01.543903 5508 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:08:01.544513 5523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:01.544660 5508 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:08:01.544746 5508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "0bdafff29ea94319800dd5742e29923d"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "0faf8bb225875aa4fd0bb79fac87aad4"
server_key_iv: "fff0259eb0f54d5fb96952d2b2019211"
server_key_version: "encryptionkey@0"
I20260812 00:08:01.544818 5508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:01.556914 5508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:01.559154 5508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:01.559297 5508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:01.559480 5508 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:08:01.559742 5508 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:08:01.559793 5508 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:01.559828 5508 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:08:01.559852 5508 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:01.565065 5508 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:35563
I20260812 00:08:01.565099 5649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:35563 every 8 connection(s)
I20260812 00:08:01.565387 5508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:08:01.568805 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 5508
I20260812 00:08:01.568912 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:08:01.569128 19693 external_mini_cluster.cc:1428] Setting key 2585a1980fad708ed7219db586ad80fe
Aug 12 00:08:01 dist-test-slave-6nmv krb5kdc[5089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493281, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:08:01.574625 5183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.566106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:44265 (local address 127.19.59.126:42229)
0812 00:08:01.566159 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:01.566161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:01.566334 (+ 173us) server_negotiation.cc:407] Connection header received
0812 00:08:01.566779 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:01.566781 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:01.566793 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:01.566852 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:01.567755 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.568260 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.569283 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.569565 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.569671 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.571999 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:01.572001 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:01.572001 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:01.572009 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:01.573300 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:01.573666 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:01.573667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:01.573668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:01.573726 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:01.573997 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:01.573998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:01.573998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:01.574112 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:01.574185 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:01.574453 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 00:08:01.574533 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:08:01.574741 5652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.566075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:44265)
0812 00:08:01.566220 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:01.566260 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:01.566682 (+ 422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:01.566911 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:01.566914 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:01.567476 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:08:01.567647 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.567651 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.568367 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.568368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.569217 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.569220 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.569690 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.569691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.569878 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.570343 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:08:01.570358 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:08:01.571889 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:08:01.573382 (+ 1493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:01.573388 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:01.573390 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:01.573591 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:01.573789 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:01.573790 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:01.573791 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:01.573928 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:01.574176 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:08:01.574183 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:08:01.574309 (+ 126us) client_negotiation.cc:769] Sending connection context
0812 00:08:01.574411 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 00:08:01.574550 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":67,"threads_started":1}
I20260812 00:08:01.575169 5650 heartbeater.cc:347] Connected to a master server at 127.19.59.126:42229
I20260812 00:08:01.575261 5650 heartbeater.cc:464] Registering TS with master...
I20260812 00:08:01.575423 5650 heartbeater.cc:511] Master 127.19.59.126:42229 requested a full tablet report, sending...
I20260812 00:08:01.575754 5137 ts_manager.cc:194] Registered new tserver with Master: 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563)
I20260812 00:08:01.576058 5137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:44265
I20260812 00:08:01.580679 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:08:01.587118 5183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.581883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37564 (local address 127.19.59.126:42229)
0812 00:08:01.581939 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:01.581941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:01.582014 (+ 73us) server_negotiation.cc:407] Connection header received
0812 00:08:01.582067 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:01.582068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:01.582075 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:01.582122 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:01.582562 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.582928 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.583613 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.583773 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.583819 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.584960 (+ 1141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:01.584961 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:01.584961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:01.584966 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:01.586139 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:01.586429 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:01.586430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:01.586430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:01.586476 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:01.586635 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:01.586636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:01.586636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:01.586757 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:01.586828 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:01.586927 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 00:08:01.586981 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:08:01.588778 5137 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37564:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:08:01.590374 5137 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:08:01.596628 5662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.592443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:35563 (local address 127.0.0.1:48410)
0812 00:08:01.592680 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:01.592689 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:01.592730 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:01.593457 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:01.593457 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:01.593459 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:01.593512 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.593513 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.594767 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.594768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.595685 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.595687 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.596332 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.596333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.596409 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.596422 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 00:08:01.596507 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 00:08:01.596558 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":25,"thread_start_us":53,"threads_started":1}
I20260812 00:08:01.596638 5663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.592681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48410 (local address 127.19.59.67:35563)
0812 00:08:01.593146 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:01.593150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:01.593158 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:08:01.593189 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:01.593191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:01.593242 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:01.593311 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:01.593586 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.594661 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.595767 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.596248 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.596330 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.596386 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:01.596521 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 00:08:01.596557 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":93,"threads_started":1}
I20260812 00:08:01.596932 5661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.592443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46479 (local address 127.0.0.1:56196)
0812 00:08:01.592571 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:01.592612 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:01.592680 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:01.593032 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:01.593043 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:01.593046 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:01.593106 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.593108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.594643 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.594644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.595703 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.595704 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.596606 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.596607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.596785 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.596790 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:08:01.596822 (+ 32us) client_negotiation.cc:240] Negotiation successful
0812 00:08:01.596861 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":2,"thread_start_us":70,"threads_started":1}
I20260812 00:08:01.597123 5665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.592906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42398 (local address 127.19.59.66:42777)
0812 00:08:01.593098 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:01.593102 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:01.593111 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:08:01.593141 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:01.593164 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:01.593180 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:01.593255 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:01.593517 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.594305 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.595802 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.596502 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.596581 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.596642 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:01.596975 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 00:08:01.597020 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":85,"threads_started":1}
I20260812 00:08:01.597249 5660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.592462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:42777 (local address 127.0.0.1:42398)
0812 00:08:01.592874 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:01.592896 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:01.592950 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:01.593349 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:01.593349 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:01.593352 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:01.593388 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.593390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.594412 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.594414 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.595696 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.595699 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.596671 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.596671 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.596848 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.596850 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:08:01.596892 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 00:08:01.596922 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"mutex_wait_us":3,"thread_start_us":77,"threads_started":1}
I20260812 00:08:01.597314 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.592682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56196 (local address 127.19.59.65:46479)
0812 00:08:01.592873 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:01.592889 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:01.592897 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:08:01.592926 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:01.592927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:01.592938 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:01.593014 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:01.593194 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.594542 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.595802 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.596502 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.597089 (+ 587us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.597157 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:01.597184 (+ 27us) server_negotiation.cc:299] Negotiation successful
0812 00:08:01.597229 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":94,"threads_started":1}
I20260812 00:08:01.597402 5576 tablet_service.cc:1467] Processing CreateTablet for tablet c2235f240c064f6abf675d54e54b1e73 (DEFAULT_TABLE table=test-table [id=a998da55893e48a5afa42f09d97d3e94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:08:01.597790 5576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2235f240c064f6abf675d54e54b1e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:08:01.598481 5276 tablet_service.cc:1467] Processing CreateTablet for tablet c2235f240c064f6abf675d54e54b1e73 (DEFAULT_TABLE table=test-table [id=a998da55893e48a5afa42f09d97d3e94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:08:01.598815 5276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2235f240c064f6abf675d54e54b1e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:08:01.600600 5666 tablet_bootstrap.cc:492] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d: Bootstrap starting.
I20260812 00:08:01.601001 5427 tablet_service.cc:1467] Processing CreateTablet for tablet c2235f240c064f6abf675d54e54b1e73 (DEFAULT_TABLE table=test-table [id=a998da55893e48a5afa42f09d97d3e94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:08:01.601317 5427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2235f240c064f6abf675d54e54b1e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:08:01.601442 5666 tablet_bootstrap.cc:654] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d: Neither blocks nor log segments found. Creating new log.
I20260812 00:08:01.601428 5667 tablet_bootstrap.cc:492] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: Bootstrap starting.
I20260812 00:08:01.601972 5667 tablet_bootstrap.cc:654] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: Neither blocks nor log segments found. Creating new log.
I20260812 00:08:01.602056 5666 log.cc:824] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:08:01.602551 5667 log.cc:824] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: Log is configured to *not* fsync() on all Append() calls
I20260812 00:08:01.602865 5666 tablet_bootstrap.cc:492] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d: No bootstrap required, opened a new log
I20260812 00:08:01.602941 5666 ts_tablet_manager.cc:1397] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:08:01.604388 5670 tablet_bootstrap.cc:492] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8: Bootstrap starting.
I20260812 00:08:01.604848 5666 raft_consensus.cc:348] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } } peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } }
I20260812 00:08:01.605011 5670 tablet_bootstrap.cc:654] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8: Neither blocks nor log segments found. Creating new log.
I20260812 00:08:01.605008 5666 raft_consensus.cc:374] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:08:01.605068 5666 raft_consensus.cc:729] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bdafff29ea94319800dd5742e29923d, State: Initialized, Role: FOLLOWER
I20260812 00:08:01.605197 5666 consensus_queue.cc:260] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } } peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } }
I20260812 00:08:01.605505 5666 ts_tablet_manager.cc:1428] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:08:01.605530 5650 heartbeater.cc:503] Master 127.19.59.126:42229 was elected leader, sending a full tablet report...
I20260812 00:08:01.605602 5670 log.cc:824] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8: Log is configured to *not* fsync() on all Append() calls
I20260812 00:08:01.606222 5667 tablet_bootstrap.cc:492] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: No bootstrap required, opened a new log
I20260812 00:08:01.606297 5667 ts_tablet_manager.cc:1397] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260812 00:08:01.607755 5667 raft_consensus.cc:348] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } } peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } }
I20260812 00:08:01.607908 5667 raft_consensus.cc:374] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:08:01.607954 5667 raft_consensus.cc:729] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833d725c7b98480083a29f052bd1a835, State: Initialized, Role: FOLLOWER
I20260812 00:08:01.608074 5667 consensus_queue.cc:260] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } } peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } }
I20260812 00:08:01.608366 5667 ts_tablet_manager.cc:1428] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:08:01.608398 5352 heartbeater.cc:503] Master 127.19.59.126:42229 was elected leader, sending a full tablet report...
I20260812 00:08:01.609158 5670 tablet_bootstrap.cc:492] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8: No bootstrap required, opened a new log
I20260812 00:08:01.609225 5670 ts_tablet_manager.cc:1397] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260812 00:08:01.610651 5670 raft_consensus.cc:348] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } } peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } }
I20260812 00:08:01.610790 5670 raft_consensus.cc:374] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:08:01.610832 5670 raft_consensus.cc:729] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6712243f72c412eaee65f27c24dfdc8, State: Initialized, Role: FOLLOWER
I20260812 00:08:01.610931 5670 consensus_queue.cc:260] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } } peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } }
I20260812 00:08:01.611176 5670 ts_tablet_manager.cc:1428] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:08:01.611207 5501 heartbeater.cc:503] Master 127.19.59.126:42229 was elected leader, sending a full tablet report...
W20260812 00:08:01.675822 5502 tablet.cc:2369] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:08:01.752821 5671 raft_consensus.cc:482] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:08:01.752966 5671 raft_consensus.cc:504] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } } peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } }
I20260812 00:08:01.753302 5671 leader_election.cc:288] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 833d725c7b98480083a29f052bd1a835 (127.19.59.65:46479), a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777)
I20260812 00:08:01.756124 5652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.753489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46479 (local address 127.19.59.67:33899)
0812 00:08:01.753564 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:01.753577 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:01.753621 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:01.753834 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:01.753835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:01.753837 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:01.753914 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.753916 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.754604 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.754605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.755277 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.755279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.755852 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.755854 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.755937 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.755941 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:08:01.755996 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 00:08:01.756025 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":2}
I20260812 00:08:01.756146 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.753573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:33899 (local address 127.19.59.65:46479)
0812 00:08:01.753620 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:01.753622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:01.753634 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:08:01.753699 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:01.753700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:01.753713 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:01.753792 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:01.754003 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.754524 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.755373 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.755775 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.755831 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.755838 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:01.756016 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 00:08:01.756063 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:08:01.756202 5665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.753626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:50517 (local address 127.19.59.66:42777)
0812 00:08:01.753685 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:01.753687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:01.753798 (+ 111us) server_negotiation.cc:407] Connection header received
0812 00:08:01.753851 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:01.753852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:01.753865 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:01.753924 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:01.754114 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.754549 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.755429 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.755845 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.755917 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.755925 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:01.756095 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 00:08:01.756133 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:08:01.756258 5677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.753500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:42777 (local address 127.19.59.67:50517)
0812 00:08:01.753717 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:01.753728 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:01.753785 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:01.753936 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:01.753937 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:01.753938 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:01.754026 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.754027 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.754650 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.754651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.755303 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.755304 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.755930 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.755931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.756009 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.756013 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:08:01.756069 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 00:08:01.756105 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":13,"thread_start_us":117,"threads_started":1}
I20260812 00:08:01.756467 5299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2235f240c064f6abf675d54e54b1e73" candidate_uuid: "0bdafff29ea94319800dd5742e29923d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833d725c7b98480083a29f052bd1a835" is_pre_election: true
I20260812 00:08:01.756628 5299 raft_consensus.cc:2454] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bdafff29ea94319800dd5742e29923d in term 0.
I20260812 00:08:01.756580 5451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2235f240c064f6abf675d54e54b1e73" candidate_uuid: "0bdafff29ea94319800dd5742e29923d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6712243f72c412eaee65f27c24dfdc8" is_pre_election: true
I20260812 00:08:01.756688 5673 raft_consensus.cc:482] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:08:01.756750 5451 raft_consensus.cc:2454] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bdafff29ea94319800dd5742e29923d in term 0.
I20260812 00:08:01.756737 5673 raft_consensus.cc:504] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } } peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } }
I20260812 00:08:01.756951 5528 leader_election.cc:302] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdafff29ea94319800dd5742e29923d, a6712243f72c412eaee65f27c24dfdc8; no voters:
I20260812 00:08:01.757041 5673 leader_election.cc:288] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563), a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777)
I20260812 00:08:01.757148 5671 raft_consensus.cc:2781] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:08:01.757197 5671 raft_consensus.cc:482] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:08:01.757225 5671 raft_consensus.cc:3037] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:08:01.758242 5671 raft_consensus.cc:504] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } } peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } }
I20260812 00:08:01.758380 5671 leader_election.cc:288] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [CANDIDATE]: Term 1 election: Requested vote from peers 833d725c7b98480083a29f052bd1a835 (127.19.59.65:46479), a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777)
I20260812 00:08:01.758558 5451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2235f240c064f6abf675d54e54b1e73" candidate_uuid: "0bdafff29ea94319800dd5742e29923d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6712243f72c412eaee65f27c24dfdc8"
I20260812 00:08:01.758558 5299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2235f240c064f6abf675d54e54b1e73" candidate_uuid: "0bdafff29ea94319800dd5742e29923d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833d725c7b98480083a29f052bd1a835"
I20260812 00:08:01.758644 5451 raft_consensus.cc:3037] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:08:01.758647 5299 raft_consensus.cc:3037] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:08:01.759471 5299 raft_consensus.cc:2454] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdafff29ea94319800dd5742e29923d in term 1.
I20260812 00:08:01.759601 5451 raft_consensus.cc:2454] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdafff29ea94319800dd5742e29923d in term 1.
I20260812 00:08:01.759649 5524 leader_election.cc:302] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdafff29ea94319800dd5742e29923d, 833d725c7b98480083a29f052bd1a835; no voters:
I20260812 00:08:01.759742 5671 raft_consensus.cc:2781] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:08:01.759850 5671 raft_consensus.cc:686] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [term 1 LEADER]: Becoming Leader. State: Replica: 0bdafff29ea94319800dd5742e29923d, State: Running, Role: LEADER
I20260812 00:08:01.759930 5671 consensus_queue.cc:237] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } } peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } }
I20260812 00:08:01.760545 5665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.757332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:34233 (local address 127.19.59.66:42777)
0812 00:08:01.757440 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:01.757442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:01.757562 (+ 120us) server_negotiation.cc:407] Connection header received
0812 00:08:01.757619 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:01.757621 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:01.757629 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:01.757677 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:01.757783 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.758291 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.759769 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.760177 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.760212 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.760217 (+ 5us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:01.760441 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 00:08:01.760474 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 00:08:01.760800 5355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.757182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:35563 (local address 127.19.59.65:54179)
0812 00:08:01.757232 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:01.757242 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:01.757278 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:01.757523 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:01.757524 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:01.757525 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:01.757584 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.757585 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.758472 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.758473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.759641 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.759644 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.760523 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.760524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.760600 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.760603 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:08:01.760653 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:08:01.760686 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":17}
I20260812 00:08:01.760818 5679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.757287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:42777 (local address 127.19.59.65:34233)
0812 00:08:01.757500 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:01.757509 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:01.757567 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:01.757679 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:01.757680 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:01.757681 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:01.757735 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.757736 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.758383 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.758385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.759661 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:01.759665 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.760286 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.760287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:01.760357 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.760361 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:08:01.760661 (+ 300us) client_negotiation.cc:240] Negotiation successful
0812 00:08:01.760701 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":39,"thread_start_us":97,"threads_started":1}
I20260812 00:08:01.760725 5137 catalog_manager.cc:5495] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bdafff29ea94319800dd5742e29923d (127.19.59.67). New cstate: current_term: 1 leader_uuid: "0bdafff29ea94319800dd5742e29923d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } health_report { overall_health: UNKNOWN } } }
I20260812 00:08:01.760931 5663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.757352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:54179 (local address 127.19.59.67:35563)
0812 00:08:01.757397 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:01.757399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:01.757408 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:08:01.757428 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:01.757429 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:01.757437 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:01.757487 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:01.757653 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.758339 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.759880 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.760353 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.760417 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.760424 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:01.760853 (+ 429us) server_negotiation.cc:299] Negotiation successful
0812 00:08:01.760886 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:08:01.761035 5451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2235f240c064f6abf675d54e54b1e73" candidate_uuid: "833d725c7b98480083a29f052bd1a835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6712243f72c412eaee65f27c24dfdc8" is_pre_election: true
I20260812 00:08:01.761127 5451 raft_consensus.cc:2379] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 833d725c7b98480083a29f052bd1a835 in current term 1: Already voted for candidate 0bdafff29ea94319800dd5742e29923d in this term.
I20260812 00:08:01.761411 5600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2235f240c064f6abf675d54e54b1e73" candidate_uuid: "833d725c7b98480083a29f052bd1a835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdafff29ea94319800dd5742e29923d" is_pre_election: true
I20260812 00:08:01.761756 5227 leader_election.cc:302] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 833d725c7b98480083a29f052bd1a835; no voters: 0bdafff29ea94319800dd5742e29923d, a6712243f72c412eaee65f27c24dfdc8
I20260812 00:08:01.761940 5673 raft_consensus.cc:2726] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 00:08:01.776389 5663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:01.774430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48424 (local address 127.19.59.67:35563)
0812 00:08:01.774486 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:01.774488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:01.774495 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:08:01.774531 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:01.774532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:01.774551 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:01.774610 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:08:01.774728 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.775137 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.775807 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:01.775968 (+ 161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:01.776013 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:01.776138 (+ 125us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:08:01.776223 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:08:01.776278 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:01.776312 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 00:08:01.776326 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:08:01.778000 5451 raft_consensus.cc:1261] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8 [term 1 FOLLOWER]: Refusing update from remote peer 0bdafff29ea94319800dd5742e29923d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:08:01.778021 5299 raft_consensus.cc:1261] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Refusing update from remote peer 0bdafff29ea94319800dd5742e29923d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:08:01.778313 5680 consensus_queue.cc:1035] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:08:01.778421 5671 consensus_queue.cc:1035] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [LEADER]: Connected to new peer: Peer: permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:08:01.780957 5686 mvcc.cc:205] Tried to move back new op lower bound from 7317476482160345088 to 7317476482089213952. Current Snapshot: MvccSnapshot[applied={T|T < 7317476482160345088}]
I20260812 00:08:01.783033 5135 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:08:01.783142 5135 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:08:01.783937 5135 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Sending DeleteTablet for 3 replicas of tablet c2235f240c064f6abf675d54e54b1e73
I20260812 00:08:01.784266 5276 tablet_service.cc:1514] Processing DeleteTablet for tablet c2235f240c064f6abf675d54e54b1e73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:08:01 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:56196
I20260812 00:08:01.784286 5576 tablet_service.cc:1514] Processing DeleteTablet for tablet c2235f240c064f6abf675d54e54b1e73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:08:01 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:48410
I20260812 00:08:01.784472 5427 tablet_service.cc:1514] Processing DeleteTablet for tablet c2235f240c064f6abf675d54e54b1e73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:08:01 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:42398
I20260812 00:08:01.784523 5695 tablet_replica.cc:330] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: stopping tablet replica
I20260812 00:08:01.784520 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 5208
I20260812 00:08:01.788282 5697 tablet_replica.cc:330] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8: stopping tablet replica
I20260812 00:08:01.788393 5697 raft_consensus.cc:2229] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:08:01.788522 5697 raft_consensus.cc:2258] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:08:01.789701 5697 ts_tablet_manager.cc:1905] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:08:01.791350 5697 ts_tablet_manager.cc:1918] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:08:01.791406 5697 log.cc:1196] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/c2235f240c064f6abf675d54e54b1e73
I20260812 00:08:01.791639 5697 ts_tablet_manager.cc:1939] T c2235f240c064f6abf675d54e54b1e73 P a6712243f72c412eaee65f27c24dfdc8: Deleting consensus metadata
I20260812 00:08:01.792032 5124 catalog_manager.cc:4841] TS a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777): tablet c2235f240c064f6abf675d54e54b1e73 (table test-table [id=a998da55893e48a5afa42f09d97d3e94]) successfully deleted
I20260812 00:08:01.799371 5696 tablet_replica.cc:330] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d: stopping tablet replica
I20260812 00:08:01.799484 5696 raft_consensus.cc:2229] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:08:01.799616 5696 raft_consensus.cc:2258] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:08:01.800040 5696 ts_tablet_manager.cc:1905] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:08:01.801941 5696 ts_tablet_manager.cc:1918] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:08:01.802017 5696 log.cc:1196] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/c2235f240c064f6abf675d54e54b1e73
I20260812 00:08:01.802286 5696 ts_tablet_manager.cc:1939] T c2235f240c064f6abf675d54e54b1e73 P 0bdafff29ea94319800dd5742e29923d: Deleting consensus metadata
I20260812 00:08:01.802727 5123 catalog_manager.cc:4841] TS 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563): tablet c2235f240c064f6abf675d54e54b1e73 (table test-table [id=a998da55893e48a5afa42f09d97d3e94]) successfully deleted
W20260812 00:08:01.803671 5120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:46479 (error 108)
W20260812 00:08:01.804168 5660 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:08:01.804020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46479 (local address 127.0.0.1:56198)
0812 00:08:01.804085 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:01.804123 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:46479: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 00:08:01.804342 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 5358
W20260812 00:08:01.804409 5120 catalog_manager.cc:4584] TS 833d725c7b98480083a29f052bd1a835 (127.19.59.65:46479): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c2235f240c064f6abf675d54e54b1e73: Network error: Client connection negotiation failed: client connection to 127.19.59.65:46479: connect: Connection reset by peer (error 104)
I20260812 00:08:01.810518 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 5508
I20260812 00:08:01.817291 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 5103
I20260812 00:08:21.823269 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:42229
--webserver_interface=127.19.59.126
--webserver_port=42521
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:42229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:08:21.898903 5700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:21.899099 5700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:21.899121 5700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:21.900250 5700 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 00:08:21.900287 5700 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 00:08:21.900298 5700 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 00:08:21.900308 5700 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:08:21.900341 5700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:21.900369 5700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:21.900398 5700 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:08:21.900421 5700 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:08:21.901840 5700 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:42229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:42229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=42521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:21.902078 5700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:21.902279 5700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:21.910215 5706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:21.910205 5707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:21.910207 5710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:21.910575 5700 server_base.cc:1034] running on GCE node
I20260812 00:08:21.910842 5700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:21.911151 5700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:21.912315 5700 hybrid_clock.cc:648] HybridClock initialized: now 1786493301912317 us; error 40 us; skew 500 ppm
Aug 12 00:08:21 dist-test-slave-6nmv krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493301, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:21.914811 5700 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:08:21.915241 5700 webserver.cc:460] Webserver started at http://127.19.59.126:42521/ using document root <none> and password file <none>
I20260812 00:08:21.915473 5700 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:21.915555 5700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:21.916828 5700 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:08:21.917503 5717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:21.917675 5700 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:08:21.917773 5700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "e819e9b0e8ec4d08a24bd35cca794fcd"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "98c39fbb6deb58053d037b63d6595a0b"
server_key_iv: "6de1cdbd6d998b7874e4ede9f0fdc587"
server_key_version: "encryptionkey@0"
I20260812 00:08:21.918188 5700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:21.926857 5700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:21.928683 5700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:21.928826 5700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:21.932704 5700 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:42229
I20260812 00:08:21.932735 5774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:42229 every 8 connection(s)
I20260812 00:08:21.933092 5700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:08:21.934417 5775 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:08:21.934985 5775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Bootstrap starting.
I20260812 00:08:21.938522 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 5700
I20260812 00:08:21.938812 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:46479
--local_ip_for_outbound_sockets=127.19.59.65
--tserver_master_addrs=127.19.59.126:42229
--webserver_port=33075
--webserver_interface=127.19.59.65
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:08:21.943149 5775 log.cc:824] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Log is configured to *not* fsync() on all Append() calls
I20260812 00:08:21.944759 5775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:08:21.945060 5775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Bootstrap complete.
I20260812 00:08:21.947178 5775 raft_consensus.cc:348] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } }
I20260812 00:08:21.947378 5775 raft_consensus.cc:729] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e819e9b0e8ec4d08a24bd35cca794fcd, State: Initialized, Role: FOLLOWER
I20260812 00:08:21.947546 5775 consensus_queue.cc:260] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } }
I20260812 00:08:21.947602 5775 raft_consensus.cc:388] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:08:21.947657 5775 raft_consensus.cc:482] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:08:21.947701 5775 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:08:21.948609 5775 raft_consensus.cc:504] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } }
I20260812 00:08:21.948685 5775 leader_election.cc:302] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e819e9b0e8ec4d08a24bd35cca794fcd; no voters:
I20260812 00:08:21.948837 5775 leader_election.cc:288] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:08:21.948920 5780 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:08:21.949062 5775 sys_catalog.cc:564] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:08:21.949138 5780 raft_consensus.cc:686] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 2 LEADER]: Becoming Leader. State: Replica: e819e9b0e8ec4d08a24bd35cca794fcd, State: Running, Role: LEADER
I20260812 00:08:21.949235 5780 consensus_queue.cc:237] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } }
I20260812 00:08:21.949564 5781 sys_catalog.cc:455] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } } }
I20260812 00:08:21.949565 5782 sys_catalog.cc:455] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader e819e9b0e8ec4d08a24bd35cca794fcd. Latest consensus state: current_term: 2 leader_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } } }
I20260812 00:08:21.949731 5781 sys_catalog.cc:458] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [sys.catalog]: This master's current role is: LEADER
I20260812 00:08:21.949752 5782 sys_catalog.cc:458] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [sys.catalog]: This master's current role is: LEADER
I20260812 00:08:21.950807 5797 catalog_manager.cc:1259] Loaded cluster ID: 3f5782a0d6844fdfbfda3bb6c7e7eb93
I20260812 00:08:21.950853 5797 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: loading cluster ID for follower catalog manager: success
I20260812 00:08:21.951967 5797 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: acquiring CA information for follower catalog manager: success
I20260812 00:08:21.952340 5797 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:08:21.952404 5791 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:08:21.952723 5791 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:08:21.952812 5791 catalog_manager.cc:1259] Loaded cluster ID: 3f5782a0d6844fdfbfda3bb6c7e7eb93
I20260812 00:08:21.952839 5791 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:08:21.952981 5791 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:08:21.953069 5791 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Loaded TSK: 0
I20260812 00:08:21.962957 5791 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Generated new TSK 1
I20260812 00:08:21.963040 5791 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:08:22.020260 5777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:22.020491 5777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:22.020512 5777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:22.021597 5777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:22.021637 5777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:22.021662 5777 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:08:22.023065 5777 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:46479
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=33075
--tserver_master_addrs=127.19.59.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:22.023285 5777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:22.023505 5777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:22.029035 5805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:22.029203 5807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:22.029237 5777 server_base.cc:1034] running on GCE node
W20260812 00:08:22.029284 5804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:22.029502 5777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:22.029785 5777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:22.030982 5777 hybrid_clock.cc:648] HybridClock initialized: now 1786493302030957 us; error 42 us; skew 500 ppm
Aug 12 00:08:22 dist-test-slave-6nmv krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493302, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:22.033675 5777 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:08:22.034163 5777 webserver.cc:460] Webserver started at http://127.19.59.65:33075/ using document root <none> and password file <none>
I20260812 00:08:22.034418 5777 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:22.034509 5777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:22.035944 5777 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:08:22.036707 5814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:22.036890 5777 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:08:22.036989 5777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "833d725c7b98480083a29f052bd1a835"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "2f912997dd79c0ca9c3d7c2319b94465"
server_key_iv: "91f6f7deb39da151a3d36a2e81068f98"
server_key_version: "encryptionkey@0"
I20260812 00:08:22.037349 5777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:22.058415 5777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:22.060592 5777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:22.060781 5777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:22.061017 5777 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:08:22.061477 5822 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 00:08:22.063112 5777 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 00:08:22.063174 5777 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 00:08:22.063215 5777 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 00:08:22.063817 5777 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 00:08:22.063922 5777 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 00:08:22.063942 5822 tablet_bootstrap.cc:492] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: Bootstrap starting.
I20260812 00:08:22.071938 5777 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:46479
I20260812 00:08:22.072034 5938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:46479 every 8 connection(s)
I20260812 00:08:22.072361 5777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:08:22.074808 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 5777
I20260812 00:08:22.074849 5822 log.cc:824] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: Log is configured to *not* fsync() on all Append() calls
I20260812 00:08:22.075152 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:42777
--local_ip_for_outbound_sockets=127.19.59.66
--tserver_master_addrs=127.19.59.126:42229
--webserver_port=37871
--webserver_interface=127.19.59.66
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:08:22.077996 5822 tablet_bootstrap.cc:492] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:08:22.078306 5822 tablet_bootstrap.cc:492] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: Bootstrap complete.
I20260812 00:08:22.079571 5822 ts_tablet_manager.cc:1397] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.003s
Aug 12 00:08:22 dist-test-slave-6nmv krb5kdc[5089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493302, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:08:22.081866 5822 raft_consensus.cc:348] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } } peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } }
I20260812 00:08:22.082253 5822 raft_consensus.cc:729] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833d725c7b98480083a29f052bd1a835, State: Initialized, Role: FOLLOWER
I20260812 00:08:22.082397 5822 consensus_queue.cc:260] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } } peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } }
I20260812 00:08:22.082679 5822 ts_tablet_manager.cc:1428] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:08:22.084460 5943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.073166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:55381 (local address 127.19.59.126:42229)
0812 00:08:22.073955 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:22.073964 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:22.074018 (+ 54us) server_negotiation.cc:407] Connection header received
0812 00:08:22.074158 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:22.074164 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:22.074227 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:22.074393 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:22.075148 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.076072 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.077471 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.078027 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.078131 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.080775 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:22.080779 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:22.080779 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:22.080790 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:22.082738 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:22.083190 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:22.083193 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:22.083194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:22.083291 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:22.083549 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:22.083550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:22.083551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:22.083759 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:22.083846 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:22.084139 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 00:08:22.084279 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":738,"thread_start_us":107,"threads_started":1}
I20260812 00:08:22.084460 5942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.073063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:55381)
0812 00:08:22.073261 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:22.073300 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:22.073701 (+ 401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:22.074420 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:22.074423 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:22.074738 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:08:22.075041 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.075048 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.076208 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.076209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.077358 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.077361 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.078236 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.078237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.078385 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.078876 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:08:22.078885 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:08:22.080680 (+ 1795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:08:22.082881 (+ 2201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:22.082886 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:22.082888 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:22.083099 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:22.083368 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:22.083369 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:22.083370 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:22.083479 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:22.083842 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:08:22.083849 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:08:22.083978 (+ 129us) client_negotiation.cc:769] Sending connection context
0812 00:08:22.084084 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 00:08:22.084267 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":122,"threads_started":1}
I20260812 00:08:22.085114 5939 heartbeater.cc:347] Connected to a master server at 127.19.59.126:42229
I20260812 00:08:22.085203 5939 heartbeater.cc:464] Registering TS with master...
I20260812 00:08:22.085388 5939 heartbeater.cc:511] Master 127.19.59.126:42229 requested a full tablet report, sending...
I20260812 00:08:22.086105 5736 ts_manager.cc:194] Registered new tserver with Master: 833d725c7b98480083a29f052bd1a835 (127.19.59.65:46479)
I20260812 00:08:22.086974 5736 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:55381
I20260812 00:08:22.087831 5939 heartbeater.cc:503] Master 127.19.59.126:42229 was elected leader, sending a full tablet report...
Aug 12 00:08:22 dist-test-slave-6nmv krb5kdc[5089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493301, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for kudu/127.19.59.65@KRBTEST.COM
I20260812 00:08:22.094969 5947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.086621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46479 (local address 127.0.0.1:59008)
0812 00:08:22.086789 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:22.086823 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:22.086883 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:22.087556 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:22.087563 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:22.087887 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:08:22.087941 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.087944 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.088834 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.088835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.089794 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.089797 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.090465 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.090466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.090525 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.090971 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:08:22.090975 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:08:22.092212 (+ 1237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:08:22.094003 (+ 1791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:22.094009 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:22.094010 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:22.094191 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:22.094385 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:22.094391 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:22.094391 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:22.094445 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:22.094713 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:08:22.094718 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:08:22.094754 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:08:22.094808 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 00:08:22.094904 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":86,"threads_started":1}
I20260812 00:08:22.095069 5948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.087229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59008 (local address 127.19.59.65:46479)
0812 00:08:22.087397 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:22.087400 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:22.087410 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:08:22.087441 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:22.087442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:22.087456 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:22.087534 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:22.088084 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.088754 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.089914 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.090384 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.090441 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.092288 (+ 1847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:22.092294 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:22.092295 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:22.092301 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:22.093920 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:22.094265 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:22.094267 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:22.094268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:22.094325 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:22.094507 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:22.094508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:22.094508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:22.094654 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:22.094725 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:22.094858 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 00:08:22.094962 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":101,"threads_started":1}
I20260812 00:08:22.095551 5869 tablet_service.cc:1514] Processing DeleteTablet for tablet c2235f240c064f6abf675d54e54b1e73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:08:01 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:59008
I20260812 00:08:22.095948 5949 tablet_replica.cc:330] stopping tablet replica
I20260812 00:08:22.096055 5949 raft_consensus.cc:2229] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:08:22.096110 5949 raft_consensus.cc:2258] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:08:22.096339 5949 ts_tablet_manager.cc:1905] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:08:22.098132 5949 ts_tablet_manager.cc:1918] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:08:22.098189 5949 log.cc:1196] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal/wals/c2235f240c064f6abf675d54e54b1e73
I20260812 00:08:22.098398 5949 ts_tablet_manager.cc:1939] T c2235f240c064f6abf675d54e54b1e73 P 833d725c7b98480083a29f052bd1a835: Deleting consensus metadata
I20260812 00:08:22.099069 5718 catalog_manager.cc:4841] TS 833d725c7b98480083a29f052bd1a835 (127.19.59.65:46479): tablet c2235f240c064f6abf675d54e54b1e73 (table test-table [id=a998da55893e48a5afa42f09d97d3e94]) successfully deleted
W20260812 00:08:22.159565 5945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:22.159790 5945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:22.159826 5945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:22.160972 5945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:22.161037 5945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:22.161080 5945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:08:22.162534 5945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:42777
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=37871
--tserver_master_addrs=127.19.59.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:22.162787 5945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:22.163014 5945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:22.167733 5957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:22.167740 5955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:22.167757 5954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:22.167754 5945 server_base.cc:1034] running on GCE node
I20260812 00:08:22.168150 5945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:22.168350 5945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:22.169528 5945 hybrid_clock.cc:648] HybridClock initialized: now 1786493302169507 us; error 36 us; skew 500 ppm
Aug 12 00:08:22 dist-test-slave-6nmv krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493302, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:22.172452 5945 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:08:22.172897 5945 webserver.cc:460] Webserver started at http://127.19.59.66:37871/ using document root <none> and password file <none>
I20260812 00:08:22.173102 5945 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:22.173185 5945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:22.174633 5945 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:08:22.175221 5964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:22.175382 5945 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:22.175482 5945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "a6712243f72c412eaee65f27c24dfdc8"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "f3e02c1953a3c29377853d01b1f27343"
server_key_iv: "f0d4c8606f5f8b1d45762d5e8d5738ec"
server_key_version: "encryptionkey@0"
I20260812 00:08:22.175851 5945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:22.189162 5945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:22.191036 5945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:22.191188 5945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:22.191406 5945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:08:22.191713 5945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:08:22.191766 5945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:22.191807 5945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:08:22.191835 5945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:22.197569 5945 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:42777
I20260812 00:08:22.197643 6088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:42777 every 8 connection(s)
I20260812 00:08:22.198017 5945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:08:22 dist-test-slave-6nmv krb5kdc[5089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493302, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:08:22.203886 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 5945
I20260812 00:08:22.204213 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:35563
--local_ip_for_outbound_sockets=127.19.59.67
--tserver_master_addrs=127.19.59.126:42229
--webserver_port=43085
--webserver_interface=127.19.59.67
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:08:22.207029 5943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.198769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:51589 (local address 127.19.59.126:42229)
0812 00:08:22.198841 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:22.198843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:22.199093 (+ 250us) server_negotiation.cc:407] Connection header received
0812 00:08:22.199588 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:22.199589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:22.199599 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:22.199651 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:22.200549 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.200983 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.201844 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.202061 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.202114 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.204107 (+ 1993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:22.204108 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:22.204108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:22.204117 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:22.205700 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:22.206092 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:22.206094 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:22.206094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:22.206149 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:22.206369 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:22.206370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:22.206370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:22.206508 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:22.206602 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:22.206826 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 00:08:22.206934 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 00:08:22.207136 6092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.198741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:51589)
0812 00:08:22.198935 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:22.198981 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:22.199497 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:22.199711 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:22.199714 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:22.200303 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:08:22.200474 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.200479 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.201062 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.201063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.201734 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.201736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.202133 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.202134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.202242 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.202683 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:08:22.202708 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:08:22.204026 (+ 1318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:08:22.205776 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:22.205782 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:22.205783 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:22.206017 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:22.206216 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:22.206217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:22.206217 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:22.206307 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:22.206587 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:08:22.206595 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:08:22.206709 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 00:08:22.206805 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 00:08:22.206943 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":116,"threads_started":1}
I20260812 00:08:22.207535 6089 heartbeater.cc:347] Connected to a master server at 127.19.59.126:42229
I20260812 00:08:22.207617 6089 heartbeater.cc:464] Registering TS with master...
I20260812 00:08:22.207799 6089 heartbeater.cc:511] Master 127.19.59.126:42229 requested a full tablet report, sending...
I20260812 00:08:22.208181 5736 ts_manager.cc:194] Registered new tserver with Master: a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777)
I20260812 00:08:22.208571 5736 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:51589
W20260812 00:08:22.283048 6093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:22.283265 6093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:22.283305 6093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:22.284379 6093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:22.284446 6093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:22.284488 6093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:08:22.285800 6093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:35563
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=43085
--tserver_master_addrs=127.19.59.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:22.286090 6093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:22.286310 6093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:22.291241 6100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:22.291260 6093 server_base.cc:1034] running on GCE node
W20260812 00:08:22.291260 6098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:22.291385 6102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:22.291644 6093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:22.291914 6093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:22.293081 6093 hybrid_clock.cc:648] HybridClock initialized: now 1786493302293063 us; error 35 us; skew 500 ppm
Aug 12 00:08:22 dist-test-slave-6nmv krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493302, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:22.295397 6093 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:08:22.295792 6093 webserver.cc:460] Webserver started at http://127.19.59.67:43085/ using document root <none> and password file <none>
I20260812 00:08:22.296018 6093 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:22.296097 6093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:22.297338 6093 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:08:22.297885 6110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:22.298025 6093 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:22.298112 6093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "0bdafff29ea94319800dd5742e29923d"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "0faf8bb225875aa4fd0bb79fac87aad4"
server_key_iv: "fff0259eb0f54d5fb96952d2b2019211"
server_key_version: "encryptionkey@0"
I20260812 00:08:22.298411 6093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:22.311154 6093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:22.312860 6093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:22.313009 6093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:22.313189 6093 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:08:22.313438 6093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:08:22.313483 6093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:22.313521 6093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:08:22.313542 6093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:22.318698 6093 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:35563
I20260812 00:08:22.318774 6236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:35563 every 8 connection(s)
I20260812 00:08:22.319064 6093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:08:22.320145 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 6093
Aug 12 00:08:22 dist-test-slave-6nmv krb5kdc[5089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493302, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:08:22.327078 6242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.320547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42092 (local address 127.19.59.126:42229)
0812 00:08:22.320827 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:22.320828 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:22.320833 (+ 5us) server_negotiation.cc:407] Connection header received
0812 00:08:22.320850 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:22.320851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:22.320876 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:22.320933 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:22.321700 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.322267 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.323055 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.323354 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.323427 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.324549 (+ 1122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:22.324550 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:22.324551 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:22.324558 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:22.325913 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:22.326259 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:22.326260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:22.326260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:22.326321 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:22.326528 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:22.326529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:22.326530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:22.326640 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:22.326816 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:22.326850 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 00:08:22.326983 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":92,"threads_started":1}
I20260812 00:08:22.328519 5943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.319776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:39523 (local address 127.19.59.126:42229)
0812 00:08:22.319842 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:22.319859 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:22.320066 (+ 207us) server_negotiation.cc:407] Connection header received
0812 00:08:22.320707 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:22.320709 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:22.320720 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:22.320766 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:22.321906 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.322372 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.323508 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.323760 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.323810 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.325975 (+ 2165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:22.325977 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:22.325977 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:22.325983 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:22.327451 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:22.327902 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:22.327903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:22.327903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:22.327961 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:22.328130 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:22.328131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:22.328131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:22.328209 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:22.328248 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:22.328406 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 00:08:22.328458 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 00:08:22.328732 6240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.319750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:39523)
0812 00:08:22.319916 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:22.319997 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:22.320604 (+ 607us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:22.320826 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:22.320829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:22.321568 (+ 739us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:08:22.321803 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.321846 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.322465 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.322466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.323402 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.323405 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.323841 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.323843 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.323998 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.324407 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:08:22.324416 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:08:22.325884 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:08:22.327538 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:22.327546 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:22.327565 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:22.327823 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:22.328004 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:22.328005 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:22.328005 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:22.328097 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:22.328241 (+ 144us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:08:22.328243 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:08:22.328332 (+ 89us) client_negotiation.cc:769] Sending connection context
0812 00:08:22.328397 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 00:08:22.328504 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":80,"threads_started":1}
I20260812 00:08:22.329203 6237 heartbeater.cc:347] Connected to a master server at 127.19.59.126:42229
I20260812 00:08:22.329298 6237 heartbeater.cc:464] Registering TS with master...
I20260812 00:08:22.329471 6237 heartbeater.cc:511] Master 127.19.59.126:42229 requested a full tablet report, sending...
I20260812 00:08:22.329898 5736 ts_manager.cc:194] Registered new tserver with Master: 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563)
I20260812 00:08:22.330295 5736 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:39523
I20260812 00:08:22.338570 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:08:22.341257 5943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.338873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42100 (local address 127.19.59.126:42229)
0812 00:08:22.338907 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:22.338909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:22.339019 (+ 110us) server_negotiation.cc:407] Connection header received
0812 00:08:22.339085 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:22.339085 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:22.339116 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:22.339173 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:08:22.339302 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.339759 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.340601 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.340776 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.340844 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.341002 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:08:22.341044 (+ 42us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 00:08:22.341188 (+ 144us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42100: token expired
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 00:08:22.341372 5943 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42100: token expired
W20260812 00:08:22.341495 5657 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.19.59.126:42229)
I20260812 00:08:22.347674 5943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.341773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42106 (local address 127.19.59.126:42229)
0812 00:08:22.341832 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:22.341835 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:22.341842 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:08:22.341860 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:22.341861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:22.341868 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:22.341914 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:22.342384 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.342803 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.343471 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.343657 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.343725 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.344969 (+ 1244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:22.344971 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:22.344971 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:22.344978 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:22.346406 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:22.346799 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:22.346800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:22.346801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:22.346876 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:22.347107 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:22.347108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:22.347108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:22.347232 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:22.347349 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:22.347471 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 00:08:22.347557 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 00:08:22.348877 5736 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42106:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:08:22.350867 5736 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:08:22.353317 5869 tablet_service.cc:1467] Processing CreateTablet for tablet 954fe0557b3140448a24d295639f559e (DEFAULT_TABLE table=test-table [id=4721894f91d8405c93b9cba86da63ca3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:08:22.353557 5869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 954fe0557b3140448a24d295639f559e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:08:22.355139 5822 tablet_bootstrap.cc:492] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835: Bootstrap starting.
I20260812 00:08:22.355530 5822 tablet_bootstrap.cc:654] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835: Neither blocks nor log segments found. Creating new log.
I20260812 00:08:22.356267 5822 tablet_bootstrap.cc:492] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835: No bootstrap required, opened a new log
I20260812 00:08:22.356317 5822 ts_tablet_manager.cc:1397] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:08:22.356643 5822 raft_consensus.cc:348] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:22.356732 5822 raft_consensus.cc:374] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:08:22.356783 5822 raft_consensus.cc:729] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833d725c7b98480083a29f052bd1a835, State: Initialized, Role: FOLLOWER
I20260812 00:08:22.356827 5822 consensus_queue.cc:260] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:22.356935 5822 ts_tablet_manager.cc:1428] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:08:22.357092 5947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.352863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:35563 (local address 127.0.0.1:40626)
0812 00:08:22.352924 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:22.352935 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:22.352967 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:22.353429 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:22.353431 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:22.353432 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:22.353486 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.353488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.354804 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.354805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.355856 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.355876 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.356870 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.356871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.356936 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.356958 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 00:08:22.356989 (+ 31us) client_negotiation.cc:240] Negotiation successful
0812 00:08:22.357031 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 00:08:22.357389 6246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.353026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40626 (local address 127.19.59.67:35563)
0812 00:08:22.353249 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:22.353254 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:22.353265 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:08:22.353304 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:22.353306 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:22.353323 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:22.353435 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:22.353563 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.354703 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.356062 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.356762 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.357205 (+ 443us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.357258 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:22.357283 (+ 25us) server_negotiation.cc:299] Negotiation successful
0812 00:08:22.357320 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":124,"threads_started":1}
I20260812 00:08:22.357699 6245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.352997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35994 (local address 127.19.59.66:42777)
0812 00:08:22.353914 (+ 917us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:22.353930 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:22.353940 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:08:22.353984 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:22.353985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:22.353999 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:22.354073 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:22.354287 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.355295 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.356456 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.357141 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.357204 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.357259 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:22.357588 (+ 329us) server_negotiation.cc:299] Negotiation successful
0812 00:08:22.357631 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":873,"thread_start_us":88,"threads_started":1}
I20260812 00:08:22.357954 6244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.352894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:42777 (local address 127.0.0.1:35994)
0812 00:08:22.353205 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:22.353216 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:22.353269 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:22.354171 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:22.354172 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:22.354174 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:22.354207 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.354209 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.355369 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.355370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.356366 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.356370 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.357426 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.357428 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.357491 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.357496 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:08:22.357837 (+ 341us) client_negotiation.cc:240] Negotiation successful
0812 00:08:22.357880 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":131,"threads_started":1}
I20260812 00:08:22.358062 6165 tablet_service.cc:1467] Processing CreateTablet for tablet 954fe0557b3140448a24d295639f559e (DEFAULT_TABLE table=test-table [id=4721894f91d8405c93b9cba86da63ca3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:08:22.358383 6165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 954fe0557b3140448a24d295639f559e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:08:22.358570 6018 tablet_service.cc:1467] Processing CreateTablet for tablet 954fe0557b3140448a24d295639f559e (DEFAULT_TABLE table=test-table [id=4721894f91d8405c93b9cba86da63ca3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:08:22.358793 6018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 954fe0557b3140448a24d295639f559e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:08:22.360942 6249 tablet_bootstrap.cc:492] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d: Bootstrap starting.
I20260812 00:08:22.361228 6250 tablet_bootstrap.cc:492] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8: Bootstrap starting.
I20260812 00:08:22.361739 6249 tablet_bootstrap.cc:654] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d: Neither blocks nor log segments found. Creating new log.
I20260812 00:08:22.361902 6250 tablet_bootstrap.cc:654] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8: Neither blocks nor log segments found. Creating new log.
I20260812 00:08:22.362515 6249 log.cc:824] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:08:22.362571 6250 log.cc:824] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8: Log is configured to *not* fsync() on all Append() calls
I20260812 00:08:22.363310 6249 tablet_bootstrap.cc:492] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d: No bootstrap required, opened a new log
I20260812 00:08:22.363380 6249 ts_tablet_manager.cc:1397] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:08:22.363435 6250 tablet_bootstrap.cc:492] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8: No bootstrap required, opened a new log
I20260812 00:08:22.363512 6250 ts_tablet_manager.cc:1397] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:08:22.365108 6249 raft_consensus.cc:348] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:22.365273 6249 raft_consensus.cc:374] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:08:22.365196 6250 raft_consensus.cc:348] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:22.365307 6249 raft_consensus.cc:729] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bdafff29ea94319800dd5742e29923d, State: Initialized, Role: FOLLOWER
I20260812 00:08:22.365316 6250 raft_consensus.cc:374] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:08:22.365348 6250 raft_consensus.cc:729] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6712243f72c412eaee65f27c24dfdc8, State: Initialized, Role: FOLLOWER
I20260812 00:08:22.365422 6249 consensus_queue.cc:260] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:22.365504 6250 consensus_queue.cc:260] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:22.365609 6253 raft_consensus.cc:482] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:08:22.365674 6249 ts_tablet_manager.cc:1428] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:08:22.365689 6253 raft_consensus.cc:504] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:22.365741 6237 heartbeater.cc:503] Master 127.19.59.126:42229 was elected leader, sending a full tablet report...
I20260812 00:08:22.366115 6250 ts_tablet_manager.cc:1428] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:08:22.366360 6089 heartbeater.cc:503] Master 127.19.59.126:42229 was elected leader, sending a full tablet report...
I20260812 00:08:22.366899 6253 leader_election.cc:288] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563), 833d725c7b98480083a29f052bd1a835 (127.19.59.65:46479)
I20260812 00:08:22.368716 6092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.366125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46479 (local address 127.19.59.66:53379)
0812 00:08:22.366235 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:22.366245 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:22.366281 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:22.366419 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:22.366419 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:22.366421 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:22.366470 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.366471 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.367242 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.367243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.367825 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.367826 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.368482 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.368483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.368551 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.368555 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:08:22.368625 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 00:08:22.368656 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260812 00:08:22.368741 5948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.366263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:53379 (local address 127.19.59.65:46479)
0812 00:08:22.366301 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:22.366302 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:22.366311 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:08:22.366334 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:22.366334 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:22.366350 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:22.366408 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:22.366528 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.367178 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.367906 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.368410 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.368457 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.368497 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:22.368618 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 00:08:22.368676 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:08:22.368985 5890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954fe0557b3140448a24d295639f559e" candidate_uuid: "a6712243f72c412eaee65f27c24dfdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833d725c7b98480083a29f052bd1a835" is_pre_election: true
I20260812 00:08:22.369141 5890 raft_consensus.cc:2454] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6712243f72c412eaee65f27c24dfdc8 in term 0.
I20260812 00:08:22.369287 6256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.366125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:35563 (local address 127.19.59.66:37155)
0812 00:08:22.366664 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:22.366673 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:22.366725 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:22.366827 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:22.366827 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:22.366828 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:22.366880 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.366881 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.367499 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.367500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.368239 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:22.368241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.369005 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.369006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:22.369097 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.369101 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:08:22.369179 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 00:08:22.369214 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"mutex_wait_us":409,"thread_start_us":86,"threads_started":1}
I20260812 00:08:22.369278 6246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.366293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:37155 (local address 127.19.59.67:35563)
0812 00:08:22.366322 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:22.366323 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:22.366715 (+ 392us) server_negotiation.cc:407] Connection header received
0812 00:08:22.366765 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:22.366766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:22.366773 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:22.366819 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:22.366946 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.367431 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.368319 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.368768 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.368855 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.368862 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:22.369192 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 00:08:22.369226 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 00:08:22.369349 5965 leader_election.cc:302] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 833d725c7b98480083a29f052bd1a835, a6712243f72c412eaee65f27c24dfdc8; no voters:
I20260812 00:08:22.369498 6253 raft_consensus.cc:2781] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:08:22.369566 6253 raft_consensus.cc:482] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:08:22.369619 6253 raft_consensus.cc:3037] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:08:22.369590 6186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954fe0557b3140448a24d295639f559e" candidate_uuid: "a6712243f72c412eaee65f27c24dfdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdafff29ea94319800dd5742e29923d" is_pre_election: true
I20260812 00:08:22.369714 6186 raft_consensus.cc:2454] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6712243f72c412eaee65f27c24dfdc8 in term 0.
I20260812 00:08:22.370307 6253 raft_consensus.cc:504] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:22.370434 6253 leader_election.cc:288] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [CANDIDATE]: Term 1 election: Requested vote from peers 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563), 833d725c7b98480083a29f052bd1a835 (127.19.59.65:46479)
I20260812 00:08:22.370541 6186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954fe0557b3140448a24d295639f559e" candidate_uuid: "a6712243f72c412eaee65f27c24dfdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdafff29ea94319800dd5742e29923d"
I20260812 00:08:22.370548 5890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954fe0557b3140448a24d295639f559e" candidate_uuid: "a6712243f72c412eaee65f27c24dfdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833d725c7b98480083a29f052bd1a835"
I20260812 00:08:22.370606 6186 raft_consensus.cc:3037] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:08:22.370606 5890 raft_consensus.cc:3037] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:08:22.371402 5890 raft_consensus.cc:2454] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6712243f72c412eaee65f27c24dfdc8 in term 1.
I20260812 00:08:22.371402 6186 raft_consensus.cc:2454] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6712243f72c412eaee65f27c24dfdc8 in term 1.
I20260812 00:08:22.371565 5965 leader_election.cc:302] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 833d725c7b98480083a29f052bd1a835, a6712243f72c412eaee65f27c24dfdc8; no voters:
I20260812 00:08:22.371672 6253 raft_consensus.cc:2781] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:08:22.371730 6253 raft_consensus.cc:686] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [term 1 LEADER]: Becoming Leader. State: Replica: a6712243f72c412eaee65f27c24dfdc8, State: Running, Role: LEADER
I20260812 00:08:22.371805 6253 consensus_queue.cc:237] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:22.372560 5736 catalog_manager.cc:5495] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66). New cstate: current_term: 1 leader_uuid: "a6712243f72c412eaee65f27c24dfdc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } health_report { overall_health: UNKNOWN } } }
I20260812 00:08:22.377259 6245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.375391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36000 (local address 127.19.59.66:42777)
0812 00:08:22.375431 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:22.375433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:22.375440 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:08:22.375506 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:22.375507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:22.375518 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:22.375567 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:08:22.375647 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.376049 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.376659 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:22.376808 (+ 149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:22.376856 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:22.377002 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:08:22.377084 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:08:22.377156 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:22.377174 (+ 18us) server_negotiation.cc:299] Negotiation successful
0812 00:08:22.377191 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:08:22.378785 6186 raft_consensus.cc:1261] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d [term 1 FOLLOWER]: Refusing update from remote peer a6712243f72c412eaee65f27c24dfdc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:08:22.378785 5890 raft_consensus.cc:1261] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Refusing update from remote peer a6712243f72c412eaee65f27c24dfdc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:08:22.379099 6253 consensus_queue.cc:1035] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:08:22.379261 6255 consensus_queue.cc:1035] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:08:22.381107 6261 mvcc.cc:205] Tried to move back new op lower bound from 7317476566541451264 to 7317476566515580928. Current Snapshot: MvccSnapshot[applied={T|T < 7317476566541451264}]
I20260812 00:08:22.382200 6260 mvcc.cc:205] Tried to move back new op lower bound from 7317476566541451264 to 7317476566515580928. Current Snapshot: MvccSnapshot[applied={T|T < 7317476566541451264}]
I20260812 00:08:22.383642 5736 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:08:22.383729 5736 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:08:22.384330 5736 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Sending DeleteTablet for 3 replicas of tablet 954fe0557b3140448a24d295639f559e
I20260812 00:08:22.384614 6018 tablet_service.cc:1514] Processing DeleteTablet for tablet 954fe0557b3140448a24d295639f559e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:08:22 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:35994
I20260812 00:08:22.384631 5869 tablet_service.cc:1514] Processing DeleteTablet for tablet 954fe0557b3140448a24d295639f559e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:08:22 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:59008
I20260812 00:08:22.384670 6165 tablet_service.cc:1514] Processing DeleteTablet for tablet 954fe0557b3140448a24d295639f559e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:08:22 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:40626
I20260812 00:08:22.384719 5949 tablet_replica.cc:330] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835: stopping tablet replica
I20260812 00:08:22.384764 5949 raft_consensus.cc:2229] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:08:22.384825 5949 raft_consensus.cc:2258] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:08:22.384837 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 5777
I20260812 00:08:22.389942 6270 tablet_replica.cc:330] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8: stopping tablet replica
I20260812 00:08:22.390056 6270 raft_consensus.cc:2229] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:08:22.390138 6270 raft_consensus.cc:2258] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:08:22.390286 6271 tablet_replica.cc:330] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d: stopping tablet replica
I20260812 00:08:22.390377 6271 raft_consensus.cc:2229] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:08:22.390478 6271 raft_consensus.cc:2258] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:08:22.391098 6271 ts_tablet_manager.cc:1905] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:08:22.392239 6270 ts_tablet_manager.cc:1905] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:08:22.392586 6271 ts_tablet_manager.cc:1918] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:08:22.392659 6271 log.cc:1196] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/954fe0557b3140448a24d295639f559e
I20260812 00:08:22.392930 6271 ts_tablet_manager.cc:1939] T 954fe0557b3140448a24d295639f559e P 0bdafff29ea94319800dd5742e29923d: Deleting consensus metadata
I20260812 00:08:22.393309 5720 catalog_manager.cc:4841] TS 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563): tablet 954fe0557b3140448a24d295639f559e (table test-table [id=4721894f91d8405c93b9cba86da63ca3]) successfully deleted
I20260812 00:08:22.394091 6270 ts_tablet_manager.cc:1918] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:08:22.394160 6270 log.cc:1196] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/954fe0557b3140448a24d295639f559e
I20260812 00:08:22.394433 6270 ts_tablet_manager.cc:1939] T 954fe0557b3140448a24d295639f559e P a6712243f72c412eaee65f27c24dfdc8: Deleting consensus metadata
I20260812 00:08:22.394816 5721 catalog_manager.cc:4841] TS a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777): tablet 954fe0557b3140448a24d295639f559e (table test-table [id=4721894f91d8405c93b9cba86da63ca3]) successfully deleted
W20260812 00:08:22.395713 5718 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:46479 (error 108)
I20260812 00:08:22.396111 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 5945
I20260812 00:08:22.396198 6244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:22.396056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46479 (local address 127.0.0.1:59010)
0812 00:08:22.396128 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:22.396167 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:46479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 00:08:22.398536 5718 catalog_manager.cc:4584] TS 833d725c7b98480083a29f052bd1a835 (127.19.59.65:46479): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 954fe0557b3140448a24d295639f559e: Network error: Client connection negotiation failed: client connection to 127.19.59.65:46479: connect: Connection refused (error 111)
I20260812 00:08:22.404268 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 6093
I20260812 00:08:22.410640 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 5700
I20260812 00:08:42.418893 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:42229
--webserver_interface=127.19.59.126
--webserver_port=42521
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:42229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:08:42.503917 6274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:42.504127 6274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:42.504148 6274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:42.505262 6274 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 00:08:42.505297 6274 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 00:08:42.505309 6274 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 00:08:42.505319 6274 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:08:42.505331 6274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:42.505343 6274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:42.505362 6274 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:08:42.505373 6274 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:08:42.506801 6274 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:42229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:42229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=42521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:42.506992 6274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:42.507156 6274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:42.512336 6280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:42.512302 6282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:42.512414 6279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:42.512483 6274 server_base.cc:1034] running on GCE node
I20260812 00:08:42.512842 6274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:42.513157 6274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:42.514317 6274 hybrid_clock.cc:648] HybridClock initialized: now 1786493322514303 us; error 48 us; skew 500 ppm
Aug 12 00:08:42 dist-test-slave-6nmv krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493322, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:42.523206 6274 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:08:42.523662 6274 webserver.cc:460] Webserver started at http://127.19.59.126:42521/ using document root <none> and password file <none>
I20260812 00:08:42.523900 6274 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:42.523967 6274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:42.525404 6274 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:08:42.526168 6290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:42.526340 6274 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:08:42.526432 6274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "e819e9b0e8ec4d08a24bd35cca794fcd"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "98c39fbb6deb58053d037b63d6595a0b"
server_key_iv: "6de1cdbd6d998b7874e4ede9f0fdc587"
server_key_version: "encryptionkey@0"
I20260812 00:08:42.526784 6274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:42.540206 6274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:42.542251 6274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:42.542420 6274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:42.546270 6274 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:42229
I20260812 00:08:42.546306 6350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:42229 every 8 connection(s)
I20260812 00:08:42.546650 6274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:08:42.547982 6351 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:08:42.548623 6351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Bootstrap starting.
I20260812 00:08:42.555896 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 6274
I20260812 00:08:42.556241 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:46479
--local_ip_for_outbound_sockets=127.19.59.65
--tserver_master_addrs=127.19.59.126:42229
--webserver_port=33075
--webserver_interface=127.19.59.65
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:08:42.557494 6351 log.cc:824] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Log is configured to *not* fsync() on all Append() calls
I20260812 00:08:42.560122 6351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:08:42.560477 6351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Bootstrap complete.
I20260812 00:08:42.562850 6351 raft_consensus.cc:348] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } }
I20260812 00:08:42.563074 6351 raft_consensus.cc:729] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e819e9b0e8ec4d08a24bd35cca794fcd, State: Initialized, Role: FOLLOWER
I20260812 00:08:42.563252 6351 consensus_queue.cc:260] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } }
I20260812 00:08:42.563319 6351 raft_consensus.cc:388] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:08:42.563395 6351 raft_consensus.cc:482] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:08:42.563459 6351 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 2 FOLLOWER]: Advancing to term 3
I20260812 00:08:42.564517 6351 raft_consensus.cc:504] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } }
I20260812 00:08:42.564615 6351 leader_election.cc:302] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e819e9b0e8ec4d08a24bd35cca794fcd; no voters:
I20260812 00:08:42.564827 6351 leader_election.cc:288] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 00:08:42.564874 6355 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 3 FOLLOWER]: Leader election won for term 3
I20260812 00:08:42.565061 6355 raft_consensus.cc:686] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [term 3 LEADER]: Becoming Leader. State: Replica: e819e9b0e8ec4d08a24bd35cca794fcd, State: Running, Role: LEADER
I20260812 00:08:42.565109 6351 sys_catalog.cc:564] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:08:42.565223 6355 consensus_queue.cc:237] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } }
I20260812 00:08:42.565624 6357 sys_catalog.cc:455] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } } }
I20260812 00:08:42.565716 6357 sys_catalog.cc:458] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [sys.catalog]: This master's current role is: LEADER
I20260812 00:08:42.566144 6358 sys_catalog.cc:455] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader e819e9b0e8ec4d08a24bd35cca794fcd. Latest consensus state: current_term: 3 leader_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e819e9b0e8ec4d08a24bd35cca794fcd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 42229 } } }
I20260812 00:08:42.566294 6358 sys_catalog.cc:458] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd [sys.catalog]: This master's current role is: LEADER
I20260812 00:08:42.566591 6366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:08:42.567476 6366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:08:42.567622 6366 catalog_manager.cc:1259] Loaded cluster ID: 3f5782a0d6844fdfbfda3bb6c7e7eb93
I20260812 00:08:42.567660 6366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:08:42.568477 6366 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:08:42.568676 6366 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Loaded TSK: 0
I20260812 00:08:42.568732 6366 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e819e9b0e8ec4d08a24bd35cca794fcd: Loaded TSK: 1
F20260812 00:08:42.568964 6366 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f99137cf9ad google::LogMessage::Fail() at ??:0
@ 0x7f99137d288a google::LogMessage::SendToLog() at ??:0
@ 0x7f99137cf4de google::LogMessage::Flush() at ??:0
@ 0x7f99137d0a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f9915f3c104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f9915f39d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f991b72d1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f991b72d48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f991b72d594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f991b6f3c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f991b6fdad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f991569d0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f9915692954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f99164f66db start_thread at ??:0
@ 0x7f99122cd61f clone at ??:0
W20260812 00:08:42.679510 6354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:42.679801 6354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:42.679840 6354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:42.681558 6354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:42.681627 6354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:42.681670 6354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:08:42.683844 6354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:46479
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=33075
--tserver_master_addrs=127.19.59.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:42.684118 6354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:42.684397 6354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:42.690022 6397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:42.690007 6398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:42.690306 6400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:42.690443 6354 server_base.cc:1034] running on GCE node
I20260812 00:08:42.690665 6354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:42.690984 6354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:42.692199 6354 hybrid_clock.cc:648] HybridClock initialized: now 1786493322692171 us; error 38 us; skew 500 ppm
Aug 12 00:08:42 dist-test-slave-6nmv krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493322, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:42.695484 6354 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:08:42.696080 6354 webserver.cc:460] Webserver started at http://127.19.59.65:33075/ using document root <none> and password file <none>
I20260812 00:08:42.696360 6354 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:42.696439 6354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:42.698272 6354 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:08:42.699167 6408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:42.699349 6354 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:08:42.699453 6354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "833d725c7b98480083a29f052bd1a835"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "2f912997dd79c0ca9c3d7c2319b94465"
server_key_iv: "91f6f7deb39da151a3d36a2e81068f98"
server_key_version: "encryptionkey@0"
I20260812 00:08:42.699807 6354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:42.719012 6354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:42.721375 6354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:42.721537 6354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:42.721794 6354 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:08:42.722333 6415 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 00:08:42.724357 6354 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 00:08:42.724419 6354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 00:08:42.724464 6354 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 00:08:42.725100 6354 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 00:08:42.725157 6354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 00:08:42.725253 6415 tablet_bootstrap.cc:492] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835: Bootstrap starting.
I20260812 00:08:42.732815 6354 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:46479
I20260812 00:08:42.733013 6535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:46479 every 8 connection(s)
I20260812 00:08:42.733239 6354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:08:42.737248 6415 log.cc:824] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835: Log is configured to *not* fsync() on all Append() calls
I20260812 00:08:42.740025 6415 tablet_bootstrap.cc:492] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:08:42.740384 6415 tablet_bootstrap.cc:492] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835: Bootstrap complete.
I20260812 00:08:42.741711 6415 ts_tablet_manager.cc:1397] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.000s
I20260812 00:08:42.742998 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 6354
I20260812 00:08:42.743289 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:42777
--local_ip_for_outbound_sockets=127.19.59.66
--tserver_master_addrs=127.19.59.126:42229
--webserver_port=37871
--webserver_interface=127.19.59.66
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:08:42.743232 6415 raft_consensus.cc:348] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:42.743552 6415 raft_consensus.cc:729] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833d725c7b98480083a29f052bd1a835, State: Initialized, Role: FOLLOWER
I20260812 00:08:42.743697 6415 consensus_queue.cc:260] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:42.743989 6415 ts_tablet_manager.cc:1428] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835: Time spent starting tablet: real 0.002s user 0.000s sys 0.006s
W20260812 00:08:42.806905 6538 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:08:42.734030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:41371)
0812 00:08:42.734196 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:42.734238 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:42.734657 (+ 419us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:42.806693 (+ 72036us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":98,"threads_started":1}
W20260812 00:08:42.807183 6536 heartbeater.cc:644] Failed to heartbeat to 127.19.59.126:42229 (0 consecutive failures): Network error: Failed to ping master at 127.19.59.126:42229: Client connection negotiation failed: client connection to 127.19.59.126:42229: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:08:42.807519 6538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:42.807405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:49389)
0812 00:08:42.807456 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:42.807492 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:08:42.807906 6538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:42.807816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:48921)
0812 00:08:42.807867 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:42.807891 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 00:08:42.808079 6536 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:08:42.838147 6542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:42.838322 6542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:42.838346 6542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:42.839604 6542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:42.839643 6542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:42.839668 6542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:08:42.841046 6542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:42777
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=37871
--tserver_master_addrs=127.19.59.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:42.841267 6542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:42.841480 6542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:42.846334 6550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:42.846382 6542 server_base.cc:1034] running on GCE node
W20260812 00:08:42.846525 6548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:42.846374 6547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:42.846801 6542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:42.846995 6542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:42.848133 6542 hybrid_clock.cc:648] HybridClock initialized: now 1786493322848123 us; error 32 us; skew 500 ppm
Aug 12 00:08:42 dist-test-slave-6nmv krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493322, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:42.850682 6542 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:08:42.851097 6542 webserver.cc:460] Webserver started at http://127.19.59.66:37871/ using document root <none> and password file <none>
I20260812 00:08:42.851305 6542 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:42.851351 6542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:42.852609 6542 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:08:42.853207 6557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:42.853386 6542 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:08:42.853488 6542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "a6712243f72c412eaee65f27c24dfdc8"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "f3e02c1953a3c29377853d01b1f27343"
server_key_iv: "f0d4c8606f5f8b1d45762d5e8d5738ec"
server_key_version: "encryptionkey@0"
I20260812 00:08:42.853794 6542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:42.869591 6542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:42.871905 6542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:42.872068 6542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:42.872300 6542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:08:42.872601 6542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:08:42.872653 6542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:42.872694 6542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:08:42.872722 6542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:42.878849 6542 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:42777
I20260812 00:08:42.878925 6692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:42777 every 8 connection(s)
I20260812 00:08:42.879238 6542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:08:42.879738 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 6542
I20260812 00:08:42.880103 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:35563
--local_ip_for_outbound_sockets=127.19.59.67
--tserver_master_addrs=127.19.59.126:42229
--webserver_port=43085
--webserver_interface=127.19.59.67
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:08:42.880401 6695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:42.879948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:39839)
0812 00:08:42.880118 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:42.880209 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":90,"threads_started":1}
W20260812 00:08:42.880826 6693 heartbeater.cc:644] Failed to heartbeat to 127.19.59.126:42229 (0 consecutive failures): Network error: Failed to ping master at 127.19.59.126:42229: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
I20260812 00:08:42.882215 6695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:42.882109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:35797)
0812 00:08:42.882156 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:42.882189 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 00:08:42.882570 6695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:42.882450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:39685)
0812 00:08:42.882504 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:42.882536 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 00:08:42.882740 6693 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:08:42.959899 6696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:42.960072 6696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:42.960093 6696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:42.961192 6696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:42.961232 6696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:42.961282 6696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:08:42.962724 6696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:35563
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=43085
--tserver_master_addrs=127.19.59.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:42.962947 6696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:42.963165 6696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:42.967893 6704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:42.967942 6696 server_base.cc:1034] running on GCE node
W20260812 00:08:42.967912 6705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:42.967912 6707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:42.968326 6696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:42.968593 6696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:42.969775 6696 hybrid_clock.cc:648] HybridClock initialized: now 1786493322969742 us; error 44 us; skew 500 ppm
Aug 12 00:08:42 dist-test-slave-6nmv krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493322, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:42.972434 6696 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:08:42.972846 6696 webserver.cc:460] Webserver started at http://127.19.59.67:43085/ using document root <none> and password file <none>
I20260812 00:08:42.973083 6696 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:42.973152 6696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:42.974496 6696 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:08:42.975064 6716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:42.975227 6696 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:08:42.975322 6696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "0bdafff29ea94319800dd5742e29923d"
format_stamp: "Formatted at 2026-08-12 00:08:01 on dist-test-slave-6nmv"
server_key: "0faf8bb225875aa4fd0bb79fac87aad4"
server_key_iv: "fff0259eb0f54d5fb96952d2b2019211"
server_key_version: "encryptionkey@0"
I20260812 00:08:42.975633 6696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:42.984571 6696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:42.986274 6696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:42.986443 6696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:42.986636 6696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:08:42.986897 6696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:08:42.986946 6696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:42.986981 6696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:08:42.987006 6696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:42.992771 6696 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:35563
I20260812 00:08:42.992839 6848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:35563 every 8 connection(s)
I20260812 00:08:42.993145 6696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:08:42.994117 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:42.993731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:40627)
0812 00:08:42.993918 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:42.993992 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":139,"threads_started":1}
W20260812 00:08:42.994457 6849 heartbeater.cc:644] Failed to heartbeat to 127.19.59.126:42229 (0 consecutive failures): Network error: Failed to ping master at 127.19.59.126:42229: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
I20260812 00:08:42.994715 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:42.994629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:56163)
0812 00:08:42.994673 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:42.994699 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 00:08:42.994957 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:42.994887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:46697)
0812 00:08:42.994924 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:42.994944 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 00:08:42.995085 6849 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:08:42.996110 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 6696
I20260812 00:08:43.808650 6853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:43.808424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:34669)
0812 00:08:43.808567 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:43.808602 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":61,"threads_started":1}
I20260812 00:08:43.883200 6854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:43.883016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:49423)
0812 00:08:43.883124 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:43.883156 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":52,"threads_started":1}
I20260812 00:08:43.995662 6855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:43.995373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:39677)
0812 00:08:43.995585 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:43.995618 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":54,"threads_started":1}
I20260812 00:08:44.083237 6856 raft_consensus.cc:482] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:08:44.083359 6856 raft_consensus.cc:504] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:44.083648 6856 leader_election.cc:288] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563), a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777)
Aug 12 00:08:44 dist-test-slave-6nmv krb5kdc[5089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493322, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.67@KRBTEST.COM
Aug 12 00:08:44 dist-test-slave-6nmv krb5kdc[5089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493322, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.66@KRBTEST.COM
I20260812 00:08:44.099400 6858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:44.083925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:49731 (local address 127.19.59.67:35563)
0812 00:08:44.084075 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:44.084091 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:44.084132 (+ 41us) server_negotiation.cc:407] Connection header received
0812 00:08:44.084607 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:44.084610 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:44.084663 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:44.084809 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:44.085576 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:44.086460 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:44.087396 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:44.087930 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:44.088024 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:44.096012 (+ 7988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:44.096016 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:44.096017 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:44.096027 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:44.097725 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:44.098215 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:44.098218 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:44.098218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:44.098327 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:44.098590 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:44.098590 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:44.098591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:44.098835 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:44.098889 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:44.099175 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 00:08:44.099284 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":48,"threads_started":1}
I20260812 00:08:44.099416 6859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:44.083922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:39365 (local address 127.19.59.66:42777)
0812 00:08:44.084129 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:44.084137 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:44.084162 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:08:44.084605 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:44.084607 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:44.084664 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:44.084809 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:44.085564 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:44.086446 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:44.087342 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:44.087894 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:44.088005 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:44.096416 (+ 8411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:44.096419 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:44.096419 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:44.096428 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:44.097934 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:44.098314 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:44.098316 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:44.098316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:44.098433 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:44.098651 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:44.098651 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:44.098652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:44.098845 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:44.098936 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:44.099163 (+ 227us) server_negotiation.cc:299] Negotiation successful
0812 00:08:44.099292 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":67,"threads_started":1}
I20260812 00:08:44.099416 6857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:44.083800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:42777 (local address 127.19.59.65:39365)
0812 00:08:44.083949 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:44.083962 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:44.084041 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:44.084842 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:44.084844 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:44.085262 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:08:44.085445 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:44.085450 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:44.086554 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:44.086555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:44.087258 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:44.087260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:44.088011 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:44.088013 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:44.088159 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:44.094208 (+ 6049us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:08:44.094218 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:08:44.096314 (+ 2096us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:08:44.098029 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:44.098030 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:44.098030 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:44.098239 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:44.098503 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:44.098503 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:44.098504 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:44.098588 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:44.098931 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:08:44.098932 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:08:44.099014 (+ 82us) client_negotiation.cc:769] Sending connection context
0812 00:08:44.099108 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 00:08:44.099276 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":31,"thread_start_us":67,"threads_started":1}
I20260812 00:08:44.099741 6853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:44.083800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:35563 (local address 127.19.59.65:49731)
0812 00:08:44.083867 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:44.084067 (+ 200us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:44.084127 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:44.084842 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:44.084844 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:44.085261 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:08:44.085445 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:44.085450 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:44.086564 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:44.086565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:44.087258 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:44.087260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:44.088013 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:44.088013 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:44.088160 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:44.094208 (+ 6048us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:08:44.094218 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:08:44.095913 (+ 1695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:08:44.097806 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:44.097833 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:44.097835 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:44.098138 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:44.098392 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:44.098393 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:44.098393 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:44.098525 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:44.098903 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:08:44.098909 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:08:44.099025 (+ 116us) client_negotiation.cc:769] Sending connection context
0812 00:08:44.099108 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 00:08:44.099347 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":179}
W20260812 00:08:44.100479 6412 leader_election.cc:341] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777): Not found: Tablet not found: 954fe0557b3140448a24d295639f559e
W20260812 00:08:44.100548 6411 leader_election.cc:341] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563): Not found: Tablet not found: 954fe0557b3140448a24d295639f559e
I20260812 00:08:44.100615 6411 leader_election.cc:302] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 833d725c7b98480083a29f052bd1a835; no voters: 0bdafff29ea94319800dd5742e29923d, a6712243f72c412eaee65f27c24dfdc8
I20260812 00:08:44.100723 6856 raft_consensus.cc:2726] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:08:44.809360 6860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:44.809152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:52211)
0812 00:08:44.809286 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:44.809317 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":64,"threads_started":1}
I20260812 00:08:44.883736 6861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:44.883569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:33661)
0812 00:08:44.883676 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:44.883703 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":55,"threads_started":1}
I20260812 00:08:44.996325 6862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:44.996115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:42833)
0812 00:08:44.996248 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:44.996286 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":58,"threads_started":1}
I20260812 00:08:45.810230 6864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:45.810010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:39307)
0812 00:08:45.810149 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:45.810182 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
I20260812 00:08:45.884392 6865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:45.884191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:49983)
0812 00:08:45.884315 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:45.884352 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
I20260812 00:08:45.997020 6866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:45.996812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:44773)
0812 00:08:45.996953 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:45.996986 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":75,"threads_started":1}
I20260812 00:08:46.307790 6868 raft_consensus.cc:482] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:08:46.307896 6868 raft_consensus.cc:504] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:46.308133 6868 leader_election.cc:288] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563), a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777)
W20260812 00:08:46.308651 6411 leader_election.cc:341] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563): Not found: Tablet not found: 954fe0557b3140448a24d295639f559e
W20260812 00:08:46.308728 6412 leader_election.cc:341] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777): Not found: Tablet not found: 954fe0557b3140448a24d295639f559e
I20260812 00:08:46.308774 6412 leader_election.cc:302] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 833d725c7b98480083a29f052bd1a835; no voters: 0bdafff29ea94319800dd5742e29923d, a6712243f72c412eaee65f27c24dfdc8
I20260812 00:08:46.308846 6868 raft_consensus.cc:2726] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:08:46.810866 6869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:46.810678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:56371)
0812 00:08:46.810790 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:46.810823 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":57,"threads_started":1}
I20260812 00:08:46.885002 6870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:46.884820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:57533)
0812 00:08:46.884932 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:46.884964 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":58,"threads_started":1}
I20260812 00:08:46.997635 6871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:46.997451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:44379)
0812 00:08:46.997570 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:46.997602 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":55,"threads_started":1}
I20260812 00:08:47.811699 6872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:47.811445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:53191)
0812 00:08:47.811601 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:47.811650 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":94,"threads_started":1}
I20260812 00:08:47.885644 6874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:47.885455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:38795)
0812 00:08:47.885573 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:47.885607 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
I20260812 00:08:47.998199 6875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:47.998021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:48927)
0812 00:08:47.998130 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:47.998161 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":58,"threads_started":1}
I20260812 00:08:48.812400 6876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:48.812180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:47643)
0812 00:08:48.812321 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:48.812355 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":72,"threads_started":1}
I20260812 00:08:48.886485 6877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:48.886249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:35631)
0812 00:08:48.886411 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:48.886446 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":81,"threads_started":1}
I20260812 00:08:48.999083 6878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:48.998716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:60371)
0812 00:08:48.998996 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:48.999042 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":76,"threads_started":1}
I20260812 00:08:49.277334 6879 raft_consensus.cc:482] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:08:49.277434 6879 raft_consensus.cc:504] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:49.277629 6879 leader_election.cc:288] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563), a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777)
W20260812 00:08:49.278033 6411 leader_election.cc:341] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563): Not found: Tablet not found: 954fe0557b3140448a24d295639f559e
W20260812 00:08:49.278086 6412 leader_election.cc:341] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777): Not found: Tablet not found: 954fe0557b3140448a24d295639f559e
I20260812 00:08:49.278115 6412 leader_election.cc:302] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 833d725c7b98480083a29f052bd1a835; no voters: 0bdafff29ea94319800dd5742e29923d, a6712243f72c412eaee65f27c24dfdc8
I20260812 00:08:49.278188 6879 raft_consensus.cc:2726] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:08:49.813251 6880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:49.812947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:58927)
0812 00:08:49.813158 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:49.813204 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":62,"threads_started":1}
I20260812 00:08:49.887272 6883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:49.887032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:38293)
0812 00:08:49.887166 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:49.887213 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":73,"threads_started":1}
I20260812 00:08:49.999737 6884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:49.999539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:56423)
0812 00:08:49.999661 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:49.999701 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":58,"threads_started":1}
I20260812 00:08:50.814116 6885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:50.813795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:45799)
0812 00:08:50.814019 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:50.814068 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":116,"threads_started":1}
I20260812 00:08:50.888197 6886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:50.887952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:42225)
0812 00:08:50.888106 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:50.888152 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":75,"threads_started":1}
I20260812 00:08:50.991386 6887 raft_consensus.cc:482] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:08:50.991479 6887 raft_consensus.cc:504] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:50.991714 6887 leader_election.cc:288] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563), a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777)
W20260812 00:08:50.992076 6411 leader_election.cc:341] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563): Not found: Tablet not found: 954fe0557b3140448a24d295639f559e
W20260812 00:08:50.992170 6412 leader_election.cc:341] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777): Not found: Tablet not found: 954fe0557b3140448a24d295639f559e
I20260812 00:08:50.992260 6412 leader_election.cc:302] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 833d725c7b98480083a29f052bd1a835; no voters: 0bdafff29ea94319800dd5742e29923d, a6712243f72c412eaee65f27c24dfdc8
I20260812 00:08:50.992347 6887 raft_consensus.cc:2726] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:08:51.000461 6888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:51.000260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:46511)
0812 00:08:51.000384 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:51.000421 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":71,"threads_started":1}
I20260812 00:08:51.814782 6889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:51.814582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:42721)
0812 00:08:51.814706 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:51.814738 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260812 00:08:51.888777 6890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:51.888596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:35791)
0812 00:08:51.888707 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:51.888735 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":56,"threads_started":1}
I20260812 00:08:52.001163 6891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:52.000976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:52873)
0812 00:08:52.001092 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:52.001127 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":62,"threads_started":1}
I20260812 00:08:52.815511 6892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:52.815269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:53137)
0812 00:08:52.815410 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:52.815464 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260812 00:08:52.889539 6893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:52.889256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:40383)
0812 00:08:52.889439 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:52.889479 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":75,"threads_started":1}
I20260812 00:08:53.001803 6894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:53.001588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:47759)
0812 00:08:53.001715 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:53.001755 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260812 00:08:53.816243 6895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:53.815935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:56693)
0812 00:08:53.816162 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:53.816198 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":79,"threads_started":1}
I20260812 00:08:53.890275 6900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:53.890050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:59855)
0812 00:08:53.890175 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:53.890211 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":62,"threads_started":1}
I20260812 00:08:54.002580 6901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:54.002345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:51087)
0812 00:08:54.002494 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:54.002539 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
I20260812 00:08:54.816992 6902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:54.816749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:45995)
0812 00:08:54.816899 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:54.816935 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":66,"threads_started":1}
I20260812 00:08:54.891062 6903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:54.890801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:52297)
0812 00:08:54.890964 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:54.891014 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":105,"threads_started":1}
I20260812 00:08:55.003226 6904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:55.003018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:35015)
0812 00:08:55.003144 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:55.003181 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":63,"threads_started":1}
I20260812 00:08:55.405884 6905 raft_consensus.cc:482] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:08:55.406029 6905 raft_consensus.cc:504] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bdafff29ea94319800dd5742e29923d" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35563 } } peers { permanent_uuid: "a6712243f72c412eaee65f27c24dfdc8" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42777 } } peers { permanent_uuid: "833d725c7b98480083a29f052bd1a835" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46479 } }
I20260812 00:08:55.406222 6905 leader_election.cc:288] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563), a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777)
W20260812 00:08:55.406590 6411 leader_election.cc:341] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0bdafff29ea94319800dd5742e29923d (127.19.59.67:35563): Not found: Tablet not found: 954fe0557b3140448a24d295639f559e
W20260812 00:08:55.406692 6412 leader_election.cc:341] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a6712243f72c412eaee65f27c24dfdc8 (127.19.59.66:42777): Not found: Tablet not found: 954fe0557b3140448a24d295639f559e
I20260812 00:08:55.406749 6412 leader_election.cc:302] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 833d725c7b98480083a29f052bd1a835; no voters: 0bdafff29ea94319800dd5742e29923d, a6712243f72c412eaee65f27c24dfdc8
I20260812 00:08:55.406831 6905 raft_consensus.cc:2726] T 954fe0557b3140448a24d295639f559e P 833d725c7b98480083a29f052bd1a835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:08:55.817761 6906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:55.817424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:36791)
0812 00:08:55.817683 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:55.817716 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":63,"threads_started":1}
I20260812 00:08:55.891781 6907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:55.891560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:36869)
0812 00:08:55.891698 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:55.891735 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
I20260812 00:08:56.003870 6909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:56.003652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:47065)
0812 00:08:56.003780 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:56.003812 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
I20260812 00:08:56.818708 6910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:56.818484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:47965)
0812 00:08:56.818627 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:56.818663 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":78,"threads_started":1}
I20260812 00:08:56.892566 6911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:56.892342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:50393)
0812 00:08:56.892482 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:56.892520 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":65,"threads_started":1}
I20260812 00:08:57.004518 6913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:57.004316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:47465)
0812 00:08:57.004443 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:57.004477 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
I20260812 00:08:57.819388 6914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:57.819185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.65:47845)
0812 00:08:57.819312 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:57.819347 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":56,"threads_started":1}
I20260812 00:08:57.893244 6915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:57.893035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.66:39501)
0812 00:08:57.893170 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:57.893200 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
I20260812 00:08:58.005137 6916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:58.004950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:42229 (local address 127.19.59.67:55447)
0812 00:08:58.005073 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:58.005102 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":73,"threads_started":1}
I20260812 00:08:58.006376 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 6354
I20260812 00:08:58.012952 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 6542
I20260812 00:08:58.019047 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 6696
2026-08-12T00:08:58Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58538 ms)
[----------] 30 tests from SecurityITest (228165 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:08:58 dist-test-slave-6nmv krb5kdc[6919](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:08:58 dist-test-slave-6nmv krb5kdc[6919](info): set up 2 sockets
Aug 12 00:08:58 dist-test-slave-6nmv krb5kdc[6919](info): commencing operation
krb5kdc: starting...
W20260812 00:08:59.060993 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:08:59 dist-test-slave-6nmv krb5kdc[6919](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:08:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:08:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:08:59.174218 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:46753
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:45035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:46753
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:08:59.249971 6933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:59.250178 6933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:59.250200 6933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:59.251327 6933 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:08:59.251366 6933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:59.251379 6933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:59.251390 6933 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:08:59.251402 6933 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:08:59.252880 6933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:45035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:46753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:46753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:59.253144 6933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:59.253376 6933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:59.258292 6941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:59.258316 6939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:59.258448 6938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:59.258337 6933 server_base.cc:1034] running on GCE node
I20260812 00:08:59.258745 6933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:59.259027 6933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:59.260162 6933 hybrid_clock.cc:648] HybridClock initialized: now 1786493339260148 us; error 28 us; skew 500 ppm
Aug 12 00:08:59 dist-test-slave-6nmv krb5kdc[6919](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493339, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:59.267988 6933 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:08:59.268460 6933 webserver.cc:460] Webserver started at http://127.19.59.126:46745/ using document root <none> and password file <none>
I20260812 00:08:59.268712 6933 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:59.268759 6933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:59.268929 6933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:08:59.270018 6933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "0ed129d39d634180af7d112ad17a581f"
format_stamp: "Formatted at 2026-08-12 00:08:59 on dist-test-slave-6nmv"
server_key: "3b58fa9ca1d9b79630953bc2344671ed"
server_key_iv: "720f979708446df5c3c5b1cc604fde27"
server_key_version: "encryptionkey@0"
I20260812 00:08:59.270370 6933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "0ed129d39d634180af7d112ad17a581f"
format_stamp: "Formatted at 2026-08-12 00:08:59 on dist-test-slave-6nmv"
server_key: "3b58fa9ca1d9b79630953bc2344671ed"
server_key_iv: "720f979708446df5c3c5b1cc604fde27"
server_key_version: "encryptionkey@0"
I20260812 00:08:59.271587 6933 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:08:59.272341 6950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:59.272576 6933 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:08:59.272665 6933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "0ed129d39d634180af7d112ad17a581f"
format_stamp: "Formatted at 2026-08-12 00:08:59 on dist-test-slave-6nmv"
server_key: "3b58fa9ca1d9b79630953bc2344671ed"
server_key_iv: "720f979708446df5c3c5b1cc604fde27"
server_key_version: "encryptionkey@0"
I20260812 00:08:59.272719 6933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:59.297787 6933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:59.299571 6933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:59.299675 6933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:59.303086 6933 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:46753
I20260812 00:08:59.303161 7009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:46753 every 8 connection(s)
I20260812 00:08:59.303476 6933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:08:59.304317 7010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:08:59.306304 7010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f: Bootstrap starting.
I20260812 00:08:59.306767 7010 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f: Neither blocks nor log segments found. Creating new log.
I20260812 00:08:59.306977 7010 log.cc:824] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:08:59.307554 7010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f: No bootstrap required, opened a new log
I20260812 00:08:59.308845 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 6933
I20260812 00:08:59.308928 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:08:59.308864 7010 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed129d39d634180af7d112ad17a581f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46753 } }
I20260812 00:08:59.309062 7010 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:08:59.309128 7010 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed129d39d634180af7d112ad17a581f, State: Initialized, Role: FOLLOWER
I20260812 00:08:59.309139 19693 external_mini_cluster.cc:1428] Setting key 1172d0b68bf39dbc1abf11e81e6c5bc7
I20260812 00:08:59.309275 7010 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed129d39d634180af7d112ad17a581f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46753 } }
I20260812 00:08:59.309365 7010 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:08:59.309398 7010 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:08:59.309451 7010 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:08:59.310452 7010 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed129d39d634180af7d112ad17a581f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46753 } }
I20260812 00:08:59.310536 7010 leader_election.cc:302] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ed129d39d634180af7d112ad17a581f; no voters:
I20260812 00:08:59.310700 7010 leader_election.cc:288] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:08:59.310729 7015 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:08:59.310828 7015 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [term 1 LEADER]: Becoming Leader. State: Replica: 0ed129d39d634180af7d112ad17a581f, State: Running, Role: LEADER
I20260812 00:08:59.310917 7010 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:08:59.310897 7015 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed129d39d634180af7d112ad17a581f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46753 } }
I20260812 00:08:59.311210 7015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ed129d39d634180af7d112ad17a581f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed129d39d634180af7d112ad17a581f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46753 } } }
I20260812 00:08:59.311354 7015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [sys.catalog]: This master's current role is: LEADER
I20260812 00:08:59.311579 7015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ed129d39d634180af7d112ad17a581f. Latest consensus state: current_term: 1 leader_uuid: "0ed129d39d634180af7d112ad17a581f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed129d39d634180af7d112ad17a581f" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 46753 } } }
I20260812 00:08:59.311652 7015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f [sys.catalog]: This master's current role is: LEADER
I20260812 00:08:59.312834 7025 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:08:59.313308 7025 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:08:59.315478 7025 catalog_manager.cc:1347] Generated new cluster ID: c818ceb7773f423eb6a9405091c412c6
I20260812 00:08:59.315524 7025 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:08:59 dist-test-slave-6nmv krb5kdc[6919](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:08:59.320099 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.309581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43184 (local address 127.19.59.126:46753)
0812 00:08:59.309789 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:59.309797 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:59.309842 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:08:59.309975 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:59.309982 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:59.310058 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:59.310209 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:59.310856 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.312208 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.313256 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.313898 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.314001 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.316383 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:59.316386 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:59.316387 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:59.316397 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:59.318275 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:59.318618 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:59.318620 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:59.318621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:59.318728 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:59.318908 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:59.318908 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:59.318909 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:59.319176 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:59.319723 (+ 547us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:59.319787 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 00:08:59.319920 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":131,"threads_started":1}
I20260812 00:08:59.322930 7025 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:08:59.323390 7025 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:08:59.325963 7025 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f: Generated new TSK 0
I20260812 00:08:59.326103 7025 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:08:59.352283 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46753
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:45035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:08:59.428623 7044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:59.428830 7044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:59.428862 7044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:59.429843 7044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:59.429900 7044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:59.429939 7044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:08:59.431319 7044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:45035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:59.431588 7044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:59.431828 7044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:59.436534 7050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:59.436533 7051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:59.436632 7044 server_base.cc:1034] running on GCE node
W20260812 00:08:59.436710 7053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:59.436892 7044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:59.437085 7044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:59.438215 7044 hybrid_clock.cc:648] HybridClock initialized: now 1786493339438202 us; error 27 us; skew 500 ppm
Aug 12 00:08:59 dist-test-slave-6nmv krb5kdc[6919](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493339, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:59.440579 7044 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:08:59.440974 7044 webserver.cc:460] Webserver started at http://127.19.59.65:43793/ using document root <none> and password file <none>
I20260812 00:08:59.441169 7044 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:59.441207 7044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:59.441329 7044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:08:59.442287 7044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "8a9c2fdabfa0438b962e4ee6de99464f"
format_stamp: "Formatted at 2026-08-12 00:08:59 on dist-test-slave-6nmv"
server_key: "03870f3663d60d0e1fff9abe98e51d14"
server_key_iv: "fed25108058f84cb3d41c941f360c43d"
server_key_version: "encryptionkey@0"
I20260812 00:08:59.442656 7044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "8a9c2fdabfa0438b962e4ee6de99464f"
format_stamp: "Formatted at 2026-08-12 00:08:59 on dist-test-slave-6nmv"
server_key: "03870f3663d60d0e1fff9abe98e51d14"
server_key_iv: "fed25108058f84cb3d41c941f360c43d"
server_key_version: "encryptionkey@0"
I20260812 00:08:59.443957 7044 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:08:59.444625 7061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:59.444813 7044 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:08:59.444898 7044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "8a9c2fdabfa0438b962e4ee6de99464f"
format_stamp: "Formatted at 2026-08-12 00:08:59 on dist-test-slave-6nmv"
server_key: "03870f3663d60d0e1fff9abe98e51d14"
server_key_iv: "fed25108058f84cb3d41c941f360c43d"
server_key_version: "encryptionkey@0"
I20260812 00:08:59.444967 7044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:59.461288 7044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:59.462972 7044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:59.463128 7044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:59.463341 7044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:08:59.463655 7044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:08:59.463712 7044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:59.463748 7044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:08:59.463774 7044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:59.469158 7044 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:46431
I20260812 00:08:59.469234 7197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:46431 every 8 connection(s)
I20260812 00:08:59.469519 7044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:08:59 dist-test-slave-6nmv krb5kdc[6919](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493339, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:08:59.476930 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 7044
I20260812 00:08:59.477061 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:08:59.477242 19693 external_mini_cluster.cc:1428] Setting key 29ad251c49fc272435d5b094b2cf373e
I20260812 00:08:59.478099 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.470202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:53109 (local address 127.19.59.126:46753)
0812 00:08:59.470284 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:59.470286 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:59.470425 (+ 139us) server_negotiation.cc:407] Connection header received
0812 00:08:59.471244 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:59.471245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:59.471256 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:59.471301 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:59.471826 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.472307 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.473228 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.473413 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.473462 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.475460 (+ 1998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:59.475461 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:59.475461 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:59.475466 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:59.476705 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:59.477063 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:59.477065 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:59.477065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:59.477143 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:59.477375 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:59.477377 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:59.477377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:59.477500 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:59.477576 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:59.477906 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 00:08:59.478001 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 00:08:59.478192 7200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.470158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:46753 (local address 127.19.59.65:53109)
0812 00:08:59.470318 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:59.470349 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:59.471155 (+ 806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:59.471348 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:59.471350 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:59.471571 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:08:59.471760 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.471765 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.472379 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.472380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.473152 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.473154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.473483 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.473484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.473584 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.474111 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:08:59.474118 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:08:59.475390 (+ 1272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:08:59.476768 (+ 1378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:59.476774 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:59.476788 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:59.476978 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:59.477201 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:59.477201 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:59.477202 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:59.477298 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:59.477577 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:08:59.477583 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:08:59.477700 (+ 117us) client_negotiation.cc:769] Sending connection context
0812 00:08:59.477877 (+ 177us) client_negotiation.cc:240] Negotiation successful
0812 00:08:59.478015 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":99,"threads_started":1}
I20260812 00:08:59.478669 7198 heartbeater.cc:347] Connected to a master server at 127.19.59.126:46753
I20260812 00:08:59.478765 7198 heartbeater.cc:464] Registering TS with master...
I20260812 00:08:59.478942 7198 heartbeater.cc:511] Master 127.19.59.126:46753 requested a full tablet report, sending...
I20260812 00:08:59.479415 6967 ts_manager.cc:194] Registered new tserver with Master: 8a9c2fdabfa0438b962e4ee6de99464f (127.19.59.65:46431)
I20260812 00:08:59.480134 6967 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:53109
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:08:59.502403 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46753
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:45035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:08:59.585649 7203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:59.585889 7203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:59.585916 7203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:59.586946 7203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:59.586983 7203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:59.587007 7203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:08:59.588315 7203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:45035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:59.588471 7203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:59.588685 7203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:59.593377 7210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:59.593377 7213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:59.593422 7209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:59.593559 7203 server_base.cc:1034] running on GCE node
I20260812 00:08:59.593850 7203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:59.594101 7203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:59.595240 7203 hybrid_clock.cc:648] HybridClock initialized: now 1786493339595228 us; error 27 us; skew 500 ppm
Aug 12 00:08:59 dist-test-slave-6nmv krb5kdc[6919](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493339, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:59.597695 7203 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:08:59.598141 7203 webserver.cc:460] Webserver started at http://127.19.59.66:36721/ using document root <none> and password file <none>
I20260812 00:08:59.598347 7203 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:59.598410 7203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:59.598546 7203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:08:59.599444 7203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "e98e0e6b6e5b4f37911f548efc89ea2b"
format_stamp: "Formatted at 2026-08-12 00:08:59 on dist-test-slave-6nmv"
server_key: "9250df83033bce0bc36aa7f50a0c3101"
server_key_iv: "46ef05c60890eeffeb7669a39a3d3ada"
server_key_version: "encryptionkey@0"
I20260812 00:08:59.599810 7203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "e98e0e6b6e5b4f37911f548efc89ea2b"
format_stamp: "Formatted at 2026-08-12 00:08:59 on dist-test-slave-6nmv"
server_key: "9250df83033bce0bc36aa7f50a0c3101"
server_key_iv: "46ef05c60890eeffeb7669a39a3d3ada"
server_key_version: "encryptionkey@0"
I20260812 00:08:59.601047 7203 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:08:59.601768 7220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:59.601974 7203 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:08:59.602078 7203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "e98e0e6b6e5b4f37911f548efc89ea2b"
format_stamp: "Formatted at 2026-08-12 00:08:59 on dist-test-slave-6nmv"
server_key: "9250df83033bce0bc36aa7f50a0c3101"
server_key_iv: "46ef05c60890eeffeb7669a39a3d3ada"
server_key_version: "encryptionkey@0"
I20260812 00:08:59.602147 7203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:59.618932 7203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:59.620543 7203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:59.620651 7203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:59.620798 7203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:08:59.621004 7203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:08:59.621037 7203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:59.621055 7203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:08:59.621065 7203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:59.626502 7203 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:42893
I20260812 00:08:59.626556 7352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:42893 every 8 connection(s)
I20260812 00:08:59.626834 7203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:08:59.627190 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 7203
I20260812 00:08:59.627308 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:08:59.627534 19693 external_mini_cluster.cc:1428] Setting key b87af5a92911e421e9408ddf20261b2b
Aug 12 00:08:59 dist-test-slave-6nmv krb5kdc[6919](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493339, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:08:59.636495 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.627543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:37881 (local address 127.19.59.126:46753)
0812 00:08:59.627621 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:59.627623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:59.627848 (+ 225us) server_negotiation.cc:407] Connection header received
0812 00:08:59.628427 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:59.628428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:59.628437 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:59.628472 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:59.629637 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.630197 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.631136 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.631329 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.631410 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.633566 (+ 2156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:59.633567 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:59.633568 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:59.633577 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:59.635189 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:59.635560 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:59.635561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:59.635562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:59.635629 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:59.635856 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:59.635857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:59.635857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:59.636001 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:59.636075 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:59.636313 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 00:08:59.636396 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 00:08:59.636510 7355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.627504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:46753 (local address 127.19.59.66:37881)
0812 00:08:59.627732 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:59.627775 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:59.628332 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:59.628544 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:59.628547 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:59.629323 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:08:59.629559 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.629565 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.630290 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.630291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.631035 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.631038 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.631422 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.631423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.631568 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.632106 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:08:59.632114 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:08:59.633470 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:08:59.635271 (+ 1801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:59.635277 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:59.635278 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:59.635484 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:59.635699 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:59.635700 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:59.635700 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:59.635793 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:59.636075 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:08:59.636079 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:08:59.636181 (+ 102us) client_negotiation.cc:769] Sending connection context
0812 00:08:59.636263 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 00:08:59.636370 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":85,"threads_started":1}
I20260812 00:08:59.637013 7353 heartbeater.cc:347] Connected to a master server at 127.19.59.126:46753
I20260812 00:08:59.637107 7353 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
I20260812 00:08:59.637295 7353 heartbeater.cc:511] Master 127.19.59.126:46753 requested a full tablet report, sending...
I20260812 00:08:59.637696 6967 ts_manager.cc:194] Registered new tserver with Master: e98e0e6b6e5b4f37911f548efc89ea2b (127.19.59.66:42893)
I20260812 00:08:59.638113 6967 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:37881
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:08:59.653748 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46753
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:45035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:08:59.729527 7358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:08:59.729694 7358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:08:59.729714 7358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:08:59.730818 7358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:08:59.730856 7358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:08:59.730880 7358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:08:59.732158 7358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:45035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:46753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:08:59.732331 7358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:08:59.732514 7358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:08:59.737167 7366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:59.737236 7358 server_base.cc:1034] running on GCE node
W20260812 00:08:59.737155 7363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:08:59.737166 7364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:08:59.737535 7358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:08:59.737766 7358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:08:59.738948 7358 hybrid_clock.cc:648] HybridClock initialized: now 1786493339738933 us; error 28 us; skew 500 ppm
Aug 12 00:08:59 dist-test-slave-6nmv krb5kdc[6919](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493339, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:08:59.741219 7358 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:08:59.741655 7358 webserver.cc:460] Webserver started at http://127.19.59.67:42601/ using document root <none> and password file <none>
I20260812 00:08:59.741925 7358 fs_manager.cc:359] Metadata directory not provided
I20260812 00:08:59.741992 7358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:08:59.742115 7358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:08:59.743028 7358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "0a07b1362b474bd9b0446d9a9723fb65"
format_stamp: "Formatted at 2026-08-12 00:08:59 on dist-test-slave-6nmv"
server_key: "f34bca6eb5e0cc9472ff44b8b2a5fbdf"
server_key_iv: "e3a63adef9c825db4fe04adc9053d64c"
server_key_version: "encryptionkey@0"
I20260812 00:08:59.743384 7358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "0a07b1362b474bd9b0446d9a9723fb65"
format_stamp: "Formatted at 2026-08-12 00:08:59 on dist-test-slave-6nmv"
server_key: "f34bca6eb5e0cc9472ff44b8b2a5fbdf"
server_key_iv: "e3a63adef9c825db4fe04adc9053d64c"
server_key_version: "encryptionkey@0"
I20260812 00:08:59.744663 7358 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:08:59.745325 7375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:59.745486 7358 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:08:59.745577 7358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "0a07b1362b474bd9b0446d9a9723fb65"
format_stamp: "Formatted at 2026-08-12 00:08:59 on dist-test-slave-6nmv"
server_key: "f34bca6eb5e0cc9472ff44b8b2a5fbdf"
server_key_iv: "e3a63adef9c825db4fe04adc9053d64c"
server_key_version: "encryptionkey@0"
I20260812 00:08:59.745656 7358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:08:59.758193 7358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:08:59.759845 7358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:08:59.759986 7358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:08:59.760177 7358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:08:59.760434 7358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:08:59.760481 7358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:59.760509 7358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:08:59.760531 7358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:08:59.766238 7358 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:35035
I20260812 00:08:59.766284 7503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:35035 every 8 connection(s)
I20260812 00:08:59.766561 7358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:08:59.768141 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 7358
I20260812 00:08:59.768273 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:08:59.768519 19693 external_mini_cluster.cc:1428] Setting key d961e0449fcae6be58d56e92988fd1f5
Aug 12 00:08:59 dist-test-slave-6nmv krb5kdc[6919](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493339, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:08:59.775625 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.767310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:53529 (local address 127.19.59.126:46753)
0812 00:08:59.767372 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:59.767374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:59.767547 (+ 173us) server_negotiation.cc:407] Connection header received
0812 00:08:59.767959 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:59.767960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:59.767969 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:59.768030 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:59.769198 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.769753 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.770709 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.770932 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.771011 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.772999 (+ 1988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:59.773000 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:59.773000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:59.773007 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:59.774423 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:59.774755 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:59.774755 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:59.774756 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:59.774826 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:59.775059 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:59.775059 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:59.775060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:59.775178 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:59.775241 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:59.775501 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 00:08:59.775562 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 00:08:59.775784 7506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.767256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:46753 (local address 127.19.59.67:53529)
0812 00:08:59.767427 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:59.767463 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:59.767885 (+ 422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:59.768118 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:59.768122 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:59.768828 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:08:59.769103 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.769109 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.769849 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.769850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.770621 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.770623 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.771019 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.771020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.771153 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.771560 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:08:59.771568 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:08:59.772914 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:08:59.774489 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:59.774494 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:59.774495 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:59.774692 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:59.774899 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:08:59.774900 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:08:59.774900 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:08:59.775002 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:08:59.775246 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:08:59.775250 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:08:59.775350 (+ 100us) client_negotiation.cc:769] Sending connection context
0812 00:08:59.775461 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 00:08:59.775581 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
I20260812 00:08:59.776284 7504 heartbeater.cc:347] Connected to a master server at 127.19.59.126:46753
I20260812 00:08:59.776360 7504 heartbeater.cc:464] Registering TS with master...
I20260812 00:08:59.776482 7504 heartbeater.cc:511] Master 127.19.59.126:46753 requested a full tablet report, sending...
I20260812 00:08:59.776801 6967 ts_manager.cc:194] Registered new tserver with Master: 0a07b1362b474bd9b0446d9a9723fb65 (127.19.59.67:35035)
I20260812 00:08:59.777160 6967 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:53529
I20260812 00:08:59.780225 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:08:59.787146 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.781552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43196 (local address 127.19.59.126:46753)
0812 00:08:59.781636 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:59.781637 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:59.781739 (+ 102us) server_negotiation.cc:407] Connection header received
0812 00:08:59.781832 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:59.781833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:59.781843 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:59.781893 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:08:59.782455 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.782924 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.783657 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.783865 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.783938 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.784967 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:08:59.784968 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:08:59.784969 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:08:59.784976 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:08:59.786059 (+ 1083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:59.786388 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:59.786389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:59.786389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:59.786445 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:08:59.786663 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:08:59.786663 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:08:59.786664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:08:59.786791 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:08:59.786886 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:59.786985 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 00:08:59.787058 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 00:08:59.788471 6967 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43196:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:08:59.789974 6967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:08:59.796232 7515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.792077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45846 (local address 127.19.59.66:42893)
0812 00:08:59.792698 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:59.792701 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:59.792712 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:08:59.792754 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:59.792756 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:59.792774 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:59.793029 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:59.793107 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.793755 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.795106 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.795803 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.795877 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.795952 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:59.796103 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 00:08:59.796147 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":77,"threads_started":1}
I20260812 00:08:59.796226 7516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.791950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:42893 (local address 127.0.0.1:45846)
0812 00:08:59.792276 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:59.792289 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:59.792345 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:59.792874 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:59.792875 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:59.792877 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:59.792928 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.792930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.793898 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.793899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.795014 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.795017 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.795884 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.795885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.795989 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.796005 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 00:08:59.796074 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 00:08:59.796131 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":102,"spinlock_wait_cycles":384,"thread_start_us":64,"threads_started":1}
I20260812 00:08:59.796224 7513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.791950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:35035 (local address 127.0.0.1:56588)
0812 00:08:59.792104 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:59.792138 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:59.792204 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:59.792606 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:59.792609 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:59.792611 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:59.792672 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.792673 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.793967 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.793967 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.795216 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.795219 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.796005 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.796006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.796062 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.796066 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:08:59.796113 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:08:59.796145 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":45,"thread_start_us":57,"threads_started":1}
I20260812 00:08:59.796497 7514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.792056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56588 (local address 127.19.59.67:35035)
0812 00:08:59.792433 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:59.792438 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:59.792454 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:08:59.792488 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:59.792489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:59.792501 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:59.792596 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:59.792766 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.793873 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.795297 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.795902 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.795981 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.796033 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:59.796409 (+ 376us) server_negotiation.cc:299] Negotiation successful
0812 00:08:59.796447 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":101,"threads_started":1}
I20260812 00:08:59.797101 7512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.792136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46431 (local address 127.0.0.1:33590)
0812 00:08:59.792307 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:59.792315 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:59.792352 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:59.792900 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:59.792900 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:59.792902 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:59.792931 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.792932 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.794172 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.794173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.795218 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.795219 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.796860 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.796861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.796918 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.796939 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 00:08:59.797004 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 00:08:59.797040 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":2,"thread_start_us":92,"threads_started":1}
I20260812 00:08:59.797139 7517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.792459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33590 (local address 127.19.59.65:46431)
0812 00:08:59.792664 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:59.792669 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:59.792678 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:08:59.792723 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:59.792725 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:59.792739 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:59.792818 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:59.792998 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.794073 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.796085 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.796791 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.796860 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.796910 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:59.797016 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 00:08:59.797062 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":98,"threads_started":1}
I20260812 00:08:59.797185 7429 tablet_service.cc:1467] Processing CreateTablet for tablet 19167efa315a48cfad6a77f9c4e911d0 (DEFAULT_TABLE table=test-table [id=a991e03cc67e4ec7be5efc39d6686220]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:08:59.797227 7274 tablet_service.cc:1467] Processing CreateTablet for tablet 19167efa315a48cfad6a77f9c4e911d0 (DEFAULT_TABLE table=test-table [id=a991e03cc67e4ec7be5efc39d6686220]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:08:59.797566 7274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19167efa315a48cfad6a77f9c4e911d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:08:59.797574 7429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19167efa315a48cfad6a77f9c4e911d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:08:59.797969 7115 tablet_service.cc:1467] Processing CreateTablet for tablet 19167efa315a48cfad6a77f9c4e911d0 (DEFAULT_TABLE table=test-table [id=a991e03cc67e4ec7be5efc39d6686220]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:08:59.798261 7115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19167efa315a48cfad6a77f9c4e911d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:08:59.800163 7518 tablet_bootstrap.cc:492] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b: Bootstrap starting.
I20260812 00:08:59.800897 7518 tablet_bootstrap.cc:654] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b: Neither blocks nor log segments found. Creating new log.
I20260812 00:08:59.801352 7520 tablet_bootstrap.cc:492] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f: Bootstrap starting.
I20260812 00:08:59.801396 7518 log.cc:824] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:08:59.801542 7519 tablet_bootstrap.cc:492] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65: Bootstrap starting.
I20260812 00:08:59.802069 7520 tablet_bootstrap.cc:654] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f: Neither blocks nor log segments found. Creating new log.
I20260812 00:08:59.802177 7519 tablet_bootstrap.cc:654] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65: Neither blocks nor log segments found. Creating new log.
I20260812 00:08:59.802346 7518 tablet_bootstrap.cc:492] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b: No bootstrap required, opened a new log
I20260812 00:08:59.802438 7518 ts_tablet_manager.cc:1397] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:08:59.802804 7520 log.cc:824] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:08:59.802851 7519 log.cc:824] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65: Log is configured to *not* fsync() on all Append() calls
I20260812 00:08:59.803570 7519 tablet_bootstrap.cc:492] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65: No bootstrap required, opened a new log
I20260812 00:08:59.803646 7519 ts_tablet_manager.cc:1397] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:08:59.803851 7520 tablet_bootstrap.cc:492] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f: No bootstrap required, opened a new log
I20260812 00:08:59.803910 7520 ts_tablet_manager.cc:1397] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:08:59.804442 7518 raft_consensus.cc:348] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a07b1362b474bd9b0446d9a9723fb65" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35035 } } peers { permanent_uuid: "8a9c2fdabfa0438b962e4ee6de99464f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46431 } } peers { permanent_uuid: "e98e0e6b6e5b4f37911f548efc89ea2b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42893 } }
I20260812 00:08:59.804605 7518 raft_consensus.cc:374] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:08:59.804661 7518 raft_consensus.cc:729] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98e0e6b6e5b4f37911f548efc89ea2b, State: Initialized, Role: FOLLOWER
I20260812 00:08:59.804862 7518 consensus_queue.cc:260] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a07b1362b474bd9b0446d9a9723fb65" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35035 } } peers { permanent_uuid: "8a9c2fdabfa0438b962e4ee6de99464f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46431 } } peers { permanent_uuid: "e98e0e6b6e5b4f37911f548efc89ea2b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42893 } }
I20260812 00:08:59.805186 7518 ts_tablet_manager.cc:1428] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:08:59.805310 7353 heartbeater.cc:503] Master 127.19.59.126:46753 was elected leader, sending a full tablet report...
I20260812 00:08:59.805640 7519 raft_consensus.cc:348] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a07b1362b474bd9b0446d9a9723fb65" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35035 } } peers { permanent_uuid: "8a9c2fdabfa0438b962e4ee6de99464f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46431 } } peers { permanent_uuid: "e98e0e6b6e5b4f37911f548efc89ea2b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42893 } }
I20260812 00:08:59.805799 7519 raft_consensus.cc:374] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:08:59.805887 7519 raft_consensus.cc:729] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a07b1362b474bd9b0446d9a9723fb65, State: Initialized, Role: FOLLOWER
I20260812 00:08:59.805918 7520 raft_consensus.cc:348] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a07b1362b474bd9b0446d9a9723fb65" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35035 } } peers { permanent_uuid: "8a9c2fdabfa0438b962e4ee6de99464f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46431 } } peers { permanent_uuid: "e98e0e6b6e5b4f37911f548efc89ea2b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42893 } }
I20260812 00:08:59.806053 7519 consensus_queue.cc:260] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a07b1362b474bd9b0446d9a9723fb65" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35035 } } peers { permanent_uuid: "8a9c2fdabfa0438b962e4ee6de99464f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46431 } } peers { permanent_uuid: "e98e0e6b6e5b4f37911f548efc89ea2b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42893 } }
I20260812 00:08:59.806120 7520 raft_consensus.cc:374] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:08:59.806159 7520 raft_consensus.cc:729] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9c2fdabfa0438b962e4ee6de99464f, State: Initialized, Role: FOLLOWER
I20260812 00:08:59.806263 7520 consensus_queue.cc:260] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a07b1362b474bd9b0446d9a9723fb65" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35035 } } peers { permanent_uuid: "8a9c2fdabfa0438b962e4ee6de99464f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46431 } } peers { permanent_uuid: "e98e0e6b6e5b4f37911f548efc89ea2b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42893 } }
I20260812 00:08:59.806301 7519 ts_tablet_manager.cc:1428] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260812 00:08:59.806318 7504 heartbeater.cc:503] Master 127.19.59.126:46753 was elected leader, sending a full tablet report...
I20260812 00:08:59.806490 7198 heartbeater.cc:503] Master 127.19.59.126:46753 was elected leader, sending a full tablet report...
I20260812 00:08:59.806491 7520 ts_tablet_manager.cc:1428] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260812 00:08:59.877413 7354 tablet.cc:2369] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:08:59.921993 7526 raft_consensus.cc:482] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:08:59.922120 7526 raft_consensus.cc:504] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a07b1362b474bd9b0446d9a9723fb65" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35035 } } peers { permanent_uuid: "8a9c2fdabfa0438b962e4ee6de99464f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46431 } } peers { permanent_uuid: "e98e0e6b6e5b4f37911f548efc89ea2b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42893 } }
I20260812 00:08:59.922470 7526 leader_election.cc:288] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a07b1362b474bd9b0446d9a9723fb65 (127.19.59.67:35035), e98e0e6b6e5b4f37911f548efc89ea2b (127.19.59.66:42893)
I20260812 00:08:59.925130 7514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.922743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:40803 (local address 127.19.59.67:35035)
0812 00:08:59.922798 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:59.922800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:59.922810 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:08:59.922844 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:59.922844 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:59.922855 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:59.922920 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:59.923082 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.923550 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.924440 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.924797 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.924878 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.924886 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:59.925024 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 00:08:59.925064 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:08:59.925130 7200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.922666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:35035 (local address 127.19.59.65:40803)
0812 00:08:59.922721 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:59.922735 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:59.922783 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:59.922925 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:59.922926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:59.922928 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:59.923006 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.923008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.923637 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.923638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.924344 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.924346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.924876 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.924877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.924955 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.924957 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:08:59.925019 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 00:08:59.925064 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 00:08:59.925408 7515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.922819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:58545 (local address 127.19.59.66:42893)
0812 00:08:59.922863 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:59.922865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:59.922987 (+ 122us) server_negotiation.cc:407] Connection header received
0812 00:08:59.923067 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:59.923069 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:59.923085 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:59.923157 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:08:59.923334 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.923790 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.924679 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.925026 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.925108 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.925115 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:59.925298 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 00:08:59.925344 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:08:59.925443 7451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19167efa315a48cfad6a77f9c4e911d0" candidate_uuid: "8a9c2fdabfa0438b962e4ee6de99464f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a07b1362b474bd9b0446d9a9723fb65" is_pre_election: true
I20260812 00:08:59.925611 7527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.922737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:42893 (local address 127.19.59.65:58545)
0812 00:08:59.922918 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:59.922925 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 00:08:59.922999 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:08:59.923163 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:08:59.923164 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:08:59.923166 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:08:59.923251 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.923253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.923889 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.923890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.924594 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:08:59.924595 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.925110 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.925111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:08:59.925205 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.925209 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:08:59.925499 (+ 290us) client_negotiation.cc:240] Negotiation successful
0812 00:08:59.925545 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":120,"threads_started":1}
I20260812 00:08:59.925637 7451 raft_consensus.cc:2454] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a9c2fdabfa0438b962e4ee6de99464f in term 0.
I20260812 00:08:59.925894 7065 leader_election.cc:302] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a07b1362b474bd9b0446d9a9723fb65, 8a9c2fdabfa0438b962e4ee6de99464f; no voters:
I20260812 00:08:59.925938 7301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19167efa315a48cfad6a77f9c4e911d0" candidate_uuid: "8a9c2fdabfa0438b962e4ee6de99464f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98e0e6b6e5b4f37911f548efc89ea2b" is_pre_election: true
I20260812 00:08:59.926041 7526 raft_consensus.cc:2781] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:08:59.926093 7526 raft_consensus.cc:482] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:08:59.926126 7526 raft_consensus.cc:3037] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:08:59.926093 7301 raft_consensus.cc:2454] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a9c2fdabfa0438b962e4ee6de99464f in term 0.
I20260812 00:08:59.926857 7526 raft_consensus.cc:504] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a07b1362b474bd9b0446d9a9723fb65" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35035 } } peers { permanent_uuid: "8a9c2fdabfa0438b962e4ee6de99464f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46431 } } peers { permanent_uuid: "e98e0e6b6e5b4f37911f548efc89ea2b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42893 } }
I20260812 00:08:59.927018 7526 leader_election.cc:288] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [CANDIDATE]: Term 1 election: Requested vote from peers 0a07b1362b474bd9b0446d9a9723fb65 (127.19.59.67:35035), e98e0e6b6e5b4f37911f548efc89ea2b (127.19.59.66:42893)
I20260812 00:08:59.927131 7451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19167efa315a48cfad6a77f9c4e911d0" candidate_uuid: "8a9c2fdabfa0438b962e4ee6de99464f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a07b1362b474bd9b0446d9a9723fb65"
I20260812 00:08:59.927187 7301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19167efa315a48cfad6a77f9c4e911d0" candidate_uuid: "8a9c2fdabfa0438b962e4ee6de99464f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98e0e6b6e5b4f37911f548efc89ea2b"
I20260812 00:08:59.927204 7451 raft_consensus.cc:3037] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:08:59.927243 7301 raft_consensus.cc:3037] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:08:59.928062 7451 raft_consensus.cc:2454] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a9c2fdabfa0438b962e4ee6de99464f in term 1.
I20260812 00:08:59.928073 7301 raft_consensus.cc:2454] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a9c2fdabfa0438b962e4ee6de99464f in term 1.
I20260812 00:08:59.928229 7062 leader_election.cc:302] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a9c2fdabfa0438b962e4ee6de99464f, e98e0e6b6e5b4f37911f548efc89ea2b; no voters:
I20260812 00:08:59.928329 7526 raft_consensus.cc:2781] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:08:59.928442 7526 raft_consensus.cc:686] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [term 1 LEADER]: Becoming Leader. State: Replica: 8a9c2fdabfa0438b962e4ee6de99464f, State: Running, Role: LEADER
I20260812 00:08:59.928529 7526 consensus_queue.cc:237] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a07b1362b474bd9b0446d9a9723fb65" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35035 } } peers { permanent_uuid: "8a9c2fdabfa0438b962e4ee6de99464f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46431 } } peers { permanent_uuid: "e98e0e6b6e5b4f37911f548efc89ea2b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42893 } }
I20260812 00:08:59.929422 6966 catalog_manager.cc:5495] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a9c2fdabfa0438b962e4ee6de99464f (127.19.59.65). New cstate: current_term: 1 leader_uuid: "8a9c2fdabfa0438b962e4ee6de99464f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a07b1362b474bd9b0446d9a9723fb65" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a9c2fdabfa0438b962e4ee6de99464f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 46431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98e0e6b6e5b4f37911f548efc89ea2b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42893 } health_report { overall_health: UNKNOWN } } }
I20260812 00:08:59.938961 7517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.936848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33600 (local address 127.19.59.65:46431)
0812 00:08:59.936890 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:08:59.936891 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:08:59.936897 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:08:59.936958 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:08:59.936959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:08:59.936971 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:08:59.937020 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:08:59.937130 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.937480 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.938271 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:08:59.938454 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:08:59.938552 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:08:59.938680 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:08:59.938768 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:08:59.938834 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:08:59.938854 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 00:08:59.938891 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:08:59.940482 7451 raft_consensus.cc:1261] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65 [term 1 FOLLOWER]: Refusing update from remote peer 8a9c2fdabfa0438b962e4ee6de99464f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:08:59.940515 7301 raft_consensus.cc:1261] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b [term 1 FOLLOWER]: Refusing update from remote peer 8a9c2fdabfa0438b962e4ee6de99464f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:08:59.940781 7528 consensus_queue.cc:1035] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a07b1362b474bd9b0446d9a9723fb65" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 35035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:08:59.940896 7526 consensus_queue.cc:1035] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98e0e6b6e5b4f37911f548efc89ea2b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:08:59.943568 7533 mvcc.cc:205] Tried to move back new op lower bound from 7317476720394067968 to 7317476720347885568. Current Snapshot: MvccSnapshot[applied={T|T < 7317476720394067968 or (T in {7317476720394067968})}]
I20260812 00:08:59.943763 7534 mvcc.cc:205] Tried to move back new op lower bound from 7317476720394067968 to 7317476720347885568. Current Snapshot: MvccSnapshot[applied={T|T < 7317476720394067968}]
I20260812 00:08:59.945595 6966 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:08:59.945700 6966 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:08:59.946451 6966 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ed129d39d634180af7d112ad17a581f: Sending DeleteTablet for 3 replicas of tablet 19167efa315a48cfad6a77f9c4e911d0
I20260812 00:08:59.946795 7274 tablet_service.cc:1514] Processing DeleteTablet for tablet 19167efa315a48cfad6a77f9c4e911d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:08:59 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:45846
I20260812 00:08:59.946828 7429 tablet_service.cc:1514] Processing DeleteTablet for tablet 19167efa315a48cfad6a77f9c4e911d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:08:59 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:56588
I20260812 00:08:59.946887 7115 tablet_service.cc:1514] Processing DeleteTablet for tablet 19167efa315a48cfad6a77f9c4e911d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:08:59 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:33590
I20260812 00:08:59.947003 7542 tablet_replica.cc:330] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65: stopping tablet replica
I20260812 00:08:59.947072 7543 tablet_replica.cc:330] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f: stopping tablet replica
I20260812 00:08:59.947178 7543 raft_consensus.cc:2229] T 19167efa315a48cfad6a77f9c4e911d0 P 8a9c2fdabfa0438b962e4ee6de99464f [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:08:59.947206 7541 tablet_replica.cc:330] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b: stopping tablet replica
I20260812 00:08:59.947296 7541 raft_consensus.cc:2229] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:08:59.947288 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 7044
I20260812 00:08:59.947431 7541 raft_consensus.cc:2258] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:08:59.950930 7541 ts_tablet_manager.cc:1905] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:08:59.947080 7542 raft_consensus.cc:2229] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:08:59.951198 7542 raft_consensus.cc:2258] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:08:59.951673 7542 ts_tablet_manager.cc:1905] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:08:59.952822 7542 ts_tablet_manager.cc:1918] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:08:59.952917 7542 log.cc:1196] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/19167efa315a48cfad6a77f9c4e911d0
I20260812 00:08:59.953024 7541 ts_tablet_manager.cc:1918] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:08:59.953126 7541 log.cc:1196] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/19167efa315a48cfad6a77f9c4e911d0
I20260812 00:08:59.953250 7542 ts_tablet_manager.cc:1939] T 19167efa315a48cfad6a77f9c4e911d0 P 0a07b1362b474bd9b0446d9a9723fb65: Deleting consensus metadata
I20260812 00:08:59.953504 7541 ts_tablet_manager.cc:1939] T 19167efa315a48cfad6a77f9c4e911d0 P e98e0e6b6e5b4f37911f548efc89ea2b: Deleting consensus metadata
I20260812 00:08:59.953691 6953 catalog_manager.cc:4841] TS 0a07b1362b474bd9b0446d9a9723fb65 (127.19.59.67:35035): tablet 19167efa315a48cfad6a77f9c4e911d0 (table test-table [id=a991e03cc67e4ec7be5efc39d6686220]) successfully deleted
I20260812 00:08:59.953934 6951 catalog_manager.cc:4841] TS e98e0e6b6e5b4f37911f548efc89ea2b (127.19.59.66:42893): tablet 19167efa315a48cfad6a77f9c4e911d0 (table test-table [id=a991e03cc67e4ec7be5efc39d6686220]) successfully deleted
W20260812 00:08:59.955590 6953 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:46431 (error 108)
I20260812 00:08:59.955916 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 7203
I20260812 00:08:59.956028 7512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:08:59.955904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:46431 (local address 127.0.0.1:33604)
0812 00:08:59.955956 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 00:08:59.955995 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:46431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 00:08:59.958432 6953 catalog_manager.cc:4584] TS 8a9c2fdabfa0438b962e4ee6de99464f (127.19.59.65:46431): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 19167efa315a48cfad6a77f9c4e911d0: Network error: Client connection negotiation failed: client connection to 127.19.59.65:46431: connect: Connection refused (error 111)
I20260812 00:08:59.965646 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 7358
I20260812 00:08:59.970939 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 6933
2026-08-12T00:08:59Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (1950 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T00:08:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:08:59Z Disabled control of system clock
I20260812 00:08:59.999459 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:40595
--webserver_interface=127.19.59.126
--webserver_port=0
--builtin_ntp_servers=127.19.59.84:43187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:40595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:09:00.079802 7548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:00.080018 7548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:00.080040 7548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:00.081099 7548 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:00.081133 7548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:00.081146 7548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:00.081158 7548 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:00.081171 7548 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:00.082425 7548 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:43187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:40595
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:40595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:00.082599 7548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:00.082819 7548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:00.087533 7555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:00.087538 7553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:00.087507 7558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:00.087898 7548 server_base.cc:1034] running on GCE node
I20260812 00:09:00.088140 7548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:00.088439 7548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:00.089614 7548 hybrid_clock.cc:648] HybridClock initialized: now 1786493340089601 us; error 45 us; skew 500 ppm
I20260812 00:09:00.090958 7548 webserver.cc:460] Webserver started at http://127.19.59.126:35727/ using document root <none> and password file <none>
I20260812 00:09:00.091208 7548 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:00.091279 7548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:00.091414 7548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:00.092437 7548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "44050357cbab49c6abe081b60b3d72d6"
format_stamp: "Formatted at 2026-08-12 00:09:00 on dist-test-slave-6nmv"
server_key: "9e1705706521ac29929bc0f7937e76c6"
server_key_iv: "aa3368fce9ed1110c05b17b50d816933"
server_key_version: "encryptionkey@0"
I20260812 00:09:00.092820 7548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "44050357cbab49c6abe081b60b3d72d6"
format_stamp: "Formatted at 2026-08-12 00:09:00 on dist-test-slave-6nmv"
server_key: "9e1705706521ac29929bc0f7937e76c6"
server_key_iv: "aa3368fce9ed1110c05b17b50d816933"
server_key_version: "encryptionkey@0"
I20260812 00:09:00.094235 7548 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:09:00.095012 7566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:00.095196 7548 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:09:00.095295 7548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "44050357cbab49c6abe081b60b3d72d6"
format_stamp: "Formatted at 2026-08-12 00:09:00 on dist-test-slave-6nmv"
server_key: "9e1705706521ac29929bc0f7937e76c6"
server_key_iv: "aa3368fce9ed1110c05b17b50d816933"
server_key_version: "encryptionkey@0"
I20260812 00:09:00.095377 7548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:00.108706 7548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:00.108999 7548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:00.109148 7548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:00.113355 7548 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:40595
I20260812 00:09:00.113390 7626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:40595 every 8 connection(s)
I20260812 00:09:00.113780 7548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:00.114810 7627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:00.117018 7627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6: Bootstrap starting.
I20260812 00:09:00.117606 7627 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:00.117969 7627 log.cc:824] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:00.118649 7627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6: No bootstrap required, opened a new log
I20260812 00:09:00.120167 7627 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44050357cbab49c6abe081b60b3d72d6" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40595 } }
I20260812 00:09:00.120301 7627 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:00.120323 7627 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44050357cbab49c6abe081b60b3d72d6, State: Initialized, Role: FOLLOWER
I20260812 00:09:00.120455 7627 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44050357cbab49c6abe081b60b3d72d6" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40595 } }
I20260812 00:09:00.120544 7627 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:00.120568 7627 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:00.120595 7627 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:00.121054 7627 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44050357cbab49c6abe081b60b3d72d6" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40595 } }
I20260812 00:09:00.121136 7627 leader_election.cc:302] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44050357cbab49c6abe081b60b3d72d6; no voters:
I20260812 00:09:00.121256 7627 leader_election.cc:288] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:00.121321 7630 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:00.121505 7630 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [term 1 LEADER]: Becoming Leader. State: Replica: 44050357cbab49c6abe081b60b3d72d6, State: Running, Role: LEADER
I20260812 00:09:00.121537 7627 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:00.121606 7630 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44050357cbab49c6abe081b60b3d72d6" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40595 } }
I20260812 00:09:00.122148 7632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44050357cbab49c6abe081b60b3d72d6. Latest consensus state: current_term: 1 leader_uuid: "44050357cbab49c6abe081b60b3d72d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44050357cbab49c6abe081b60b3d72d6" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40595 } } }
I20260812 00:09:00.122249 7632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:00.122586 7631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44050357cbab49c6abe081b60b3d72d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44050357cbab49c6abe081b60b3d72d6" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40595 } } }
I20260812 00:09:00.122596 7639 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:00.122728 7631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:00.123234 7639 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:00.123859 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 7548
I20260812 00:09:00.123978 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:00.124212 19693 external_mini_cluster.cc:1428] Setting key b43d2f5a4f0b8603b8b1eaddb9545cec
I20260812 00:09:00.125286 7639 catalog_manager.cc:1347] Generated new cluster ID: 43847461654542fb83d43b32fd6a9cfb
I20260812 00:09:00.125358 7639 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:00.130662 7651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.124705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40704 (local address 127.19.59.126:40595)
0812 00:09:00.125369 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:00.125377 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:00.125408 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:09:00.125515 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:00.125523 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:00.125588 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:00.125728 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:00.126007 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.127417 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.128459 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.129087 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.129211 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.129918 (+ 707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:00.129922 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:00.129923 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:00.130139 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:00.130179 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:00.130193 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:00.130263 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:00.130328 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 00:09:00.130414 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":52,"threads_started":1}
I20260812 00:09:00.142452 7639 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:00.143131 7639 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:00.150606 7639 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6: Generated new TSK 0
I20260812 00:09:00.150775 7639 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:00.152124 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40595
--builtin_ntp_servers=127.19.59.84:43187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:09:00.232493 7652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:00.232731 7652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:00.232765 7652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:00.233907 7652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:00.233969 7652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:00.234009 7652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:09:00.235324 7652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:43187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:00.235612 7652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:00.235896 7652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:00.240757 7658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:00.240850 7663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:00.241257 7659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:00.241173 7652 server_base.cc:1034] running on GCE node
I20260812 00:09:00.241638 7652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:00.241914 7652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:00.243053 7652 hybrid_clock.cc:648] HybridClock initialized: now 1786493340243034 us; error 31 us; skew 500 ppm
I20260812 00:09:00.244530 7652 webserver.cc:460] Webserver started at http://127.19.59.65:42509/ using document root <none> and password file <none>
I20260812 00:09:00.244817 7652 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:00.244887 7652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:00.245038 7652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:00.246142 7652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "d5b09ee92a074479b52bcc5217a50103"
format_stamp: "Formatted at 2026-08-12 00:09:00 on dist-test-slave-6nmv"
server_key: "8ce16d48d0a945f7efd4c67888ba7bd8"
server_key_iv: "2c3df89addd40cff9c21fe43515e67f4"
server_key_version: "encryptionkey@0"
I20260812 00:09:00.246480 7652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "d5b09ee92a074479b52bcc5217a50103"
format_stamp: "Formatted at 2026-08-12 00:09:00 on dist-test-slave-6nmv"
server_key: "8ce16d48d0a945f7efd4c67888ba7bd8"
server_key_iv: "2c3df89addd40cff9c21fe43515e67f4"
server_key_version: "encryptionkey@0"
I20260812 00:09:00.247757 7652 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:09:00.248447 7670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:00.248600 7652 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:00.248696 7652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "d5b09ee92a074479b52bcc5217a50103"
format_stamp: "Formatted at 2026-08-12 00:09:00 on dist-test-slave-6nmv"
server_key: "8ce16d48d0a945f7efd4c67888ba7bd8"
server_key_iv: "2c3df89addd40cff9c21fe43515e67f4"
server_key_version: "encryptionkey@0"
I20260812 00:09:00.248778 7652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:00.258859 7652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:00.259122 7652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:00.259270 7652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:00.259505 7652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:09:00.259809 7652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:09:00.259866 7652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:00.259907 7652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:09:00.259930 7652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:00.265555 7652 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:45193
I20260812 00:09:00.265623 7811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:45193 every 8 connection(s)
I20260812 00:09:00.265986 7652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:09:00.267515 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 7652
I20260812 00:09:00.267637 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:09:00.267813 19693 external_mini_cluster.cc:1428] Setting key a6cb4762fa836fddc5feec52a29051f2
I20260812 00:09:00.268687 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40595
--builtin_ntp_servers=127.19.59.84:43187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:09:00.271299 7651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.266701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:47397 (local address 127.19.59.126:40595)
0812 00:09:00.266778 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:00.266781 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:00.266973 (+ 192us) server_negotiation.cc:407] Connection header received
0812 00:09:00.267439 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:00.267441 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:00.267459 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:00.267545 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:00.268351 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.268953 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.269940 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.270148 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.270219 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.271027 (+ 808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:00.271029 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:00.271029 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:00.271034 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:00.271049 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:00.271053 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:00.271100 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:00.271194 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 00:09:00.271224 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 00:09:00.271530 7815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.266662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:40595 (local address 127.19.59.65:47397)
0812 00:09:00.266858 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:00.266889 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:00.267340 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:00.267624 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:00.267629 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:00.267640 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:00.268265 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.268271 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.269050 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.269051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.269804 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.269857 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.270228 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.270229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.270360 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.270867 (+ 507us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:09:00.270867 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:00.270892 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:09:00.270912 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:00.271100 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:00.271105 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:00.271108 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:09:00.271195 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 00:09:00.271291 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":106,"threads_started":1}
I20260812 00:09:00.272109 7813 heartbeater.cc:347] Connected to a master server at 127.19.59.126:40595
I20260812 00:09:00.272210 7813 heartbeater.cc:464] Registering TS with master...
I20260812 00:09:00.272378 7813 heartbeater.cc:511] Master 127.19.59.126:40595 requested a full tablet report, sending...
I20260812 00:09:00.272920 7587 ts_manager.cc:194] Registered new tserver with Master: d5b09ee92a074479b52bcc5217a50103 (127.19.59.65:45193)
I20260812 00:09:00.273932 7587 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.59.65:47397
W20260812 00:09:00.347936 7816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:00.348165 7816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:00.348189 7816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:00.349221 7816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:00.349258 7816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:00.349282 7816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:09:00.350464 7816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:43187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:00.350623 7816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:00.350826 7816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:00.355680 7826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:00.355676 7822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:00.355718 7824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:00.355937 7816 server_base.cc:1034] running on GCE node
I20260812 00:09:00.356185 7816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:00.356391 7816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:00.357537 7816 hybrid_clock.cc:648] HybridClock initialized: now 1786493340357531 us; error 31 us; skew 500 ppm
I20260812 00:09:00.358664 7816 webserver.cc:460] Webserver started at http://127.19.59.66:33597/ using document root <none> and password file <none>
I20260812 00:09:00.358884 7816 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:00.358945 7816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:00.359128 7816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:00.360057 7816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "355bd2cd82fc4b5488640c34a4662b02"
format_stamp: "Formatted at 2026-08-12 00:09:00 on dist-test-slave-6nmv"
server_key: "ac81c31437ea4284b25edd334544095b"
server_key_iv: "34f0663e2cf875a785b955f7c6f7324e"
server_key_version: "encryptionkey@0"
I20260812 00:09:00.360412 7816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "355bd2cd82fc4b5488640c34a4662b02"
format_stamp: "Formatted at 2026-08-12 00:09:00 on dist-test-slave-6nmv"
server_key: "ac81c31437ea4284b25edd334544095b"
server_key_iv: "34f0663e2cf875a785b955f7c6f7324e"
server_key_version: "encryptionkey@0"
I20260812 00:09:00.361666 7816 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:09:00.362403 7832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:00.362572 7816 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:00.362679 7816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "355bd2cd82fc4b5488640c34a4662b02"
format_stamp: "Formatted at 2026-08-12 00:09:00 on dist-test-slave-6nmv"
server_key: "ac81c31437ea4284b25edd334544095b"
server_key_iv: "34f0663e2cf875a785b955f7c6f7324e"
server_key_version: "encryptionkey@0"
I20260812 00:09:00.362758 7816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:00.376103 7816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:00.376343 7816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:00.376470 7816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:00.376665 7816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:09:00.376962 7816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:09:00.377014 7816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:00.377053 7816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:09:00.377077 7816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:00.382608 7816 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:36709
I20260812 00:09:00.382649 7963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:36709 every 8 connection(s)
I20260812 00:09:00.382942 7816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:09:00.384312 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 7816
I20260812 00:09:00.384421 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:09:00.384637 19693 external_mini_cluster.cc:1428] Setting key 86abe93e1dc068ae9874f7196f6e2371
I20260812 00:09:00.385676 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40595
--builtin_ntp_servers=127.19.59.84:43187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:09:00.388422 7651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.383578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:46041 (local address 127.19.59.126:40595)
0812 00:09:00.383648 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:00.383650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:00.383877 (+ 227us) server_negotiation.cc:407] Connection header received
0812 00:09:00.384327 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:00.384329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:00.384342 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:00.384408 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:00.385224 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.385964 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.386873 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.387192 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.387285 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.388206 (+ 921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:00.388208 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:00.388208 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:00.388212 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:00.388226 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:00.388230 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:00.388273 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:00.388345 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 00:09:00.388367 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:09:00.388682 7967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.383573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:40595 (local address 127.19.59.66:46041)
0812 00:09:00.383758 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:00.383787 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:00.384220 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:00.384496 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:00.384500 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:00.384516 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:00.385127 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.385133 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.386050 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.386051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.386770 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.386772 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.387362 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.387363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.387498 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.388044 (+ 546us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:09:00.388060 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:00.388085 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:09:00.388104 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:00.388276 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:00.388280 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:00.388283 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:09:00.388349 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 00:09:00.388458 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":87,"threads_started":1}
I20260812 00:09:00.389160 7965 heartbeater.cc:347] Connected to a master server at 127.19.59.126:40595
I20260812 00:09:00.389241 7965 heartbeater.cc:464] Registering TS with master...
I20260812 00:09:00.389411 7965 heartbeater.cc:511] Master 127.19.59.126:40595 requested a full tablet report, sending...
I20260812 00:09:00.389761 7587 ts_manager.cc:194] Registered new tserver with Master: 355bd2cd82fc4b5488640c34a4662b02 (127.19.59.66:36709)
I20260812 00:09:00.390125 7587 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.59.66:46041
W20260812 00:09:00.463856 7968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:00.464071 7968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:00.464100 7968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:00.465168 7968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:00.465225 7968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:00.465265 7968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:09:00.466518 7968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:43187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:00.466768 7968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:00.467031 7968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:00.471740 7977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:00.471750 7974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:00.471872 7968 server_base.cc:1034] running on GCE node
W20260812 00:09:00.471750 7975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:00.472122 7968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:00.472363 7968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:00.473529 7968 hybrid_clock.cc:648] HybridClock initialized: now 1786493340473525 us; error 37 us; skew 500 ppm
I20260812 00:09:00.474821 7968 webserver.cc:460] Webserver started at http://127.19.59.67:43977/ using document root <none> and password file <none>
I20260812 00:09:00.475059 7968 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:00.475128 7968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:00.475262 7968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:00.476296 7968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "5dd038f684d2459788953b0e8589929f"
format_stamp: "Formatted at 2026-08-12 00:09:00 on dist-test-slave-6nmv"
server_key: "89ed0ec6b13774fda8f9c05845a09c16"
server_key_iv: "ebf53acd3119806f27821cdd98b9fc3f"
server_key_version: "encryptionkey@0"
I20260812 00:09:00.476661 7968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "5dd038f684d2459788953b0e8589929f"
format_stamp: "Formatted at 2026-08-12 00:09:00 on dist-test-slave-6nmv"
server_key: "89ed0ec6b13774fda8f9c05845a09c16"
server_key_iv: "ebf53acd3119806f27821cdd98b9fc3f"
server_key_version: "encryptionkey@0"
I20260812 00:09:00.477977 7968 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:09:00.478682 7984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:00.478842 7968 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:00.478935 7968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "5dd038f684d2459788953b0e8589929f"
format_stamp: "Formatted at 2026-08-12 00:09:00 on dist-test-slave-6nmv"
server_key: "89ed0ec6b13774fda8f9c05845a09c16"
server_key_iv: "ebf53acd3119806f27821cdd98b9fc3f"
server_key_version: "encryptionkey@0"
I20260812 00:09:00.479012 7968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:00.488305 7968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:00.488538 7968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:00.488665 7968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:00.488855 7968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:09:00.489130 7968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:09:00.489176 7968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:00.489205 7968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:09:00.489229 7968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:00.495254 7968 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:43187
I20260812 00:09:00.495288 8113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:43187 every 8 connection(s)
I20260812 00:09:00.495571 7968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:09:00.499924 7651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.496242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:58579 (local address 127.19.59.126:40595)
0812 00:09:00.496296 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:00.496298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:00.496496 (+ 198us) server_negotiation.cc:407] Connection header received
0812 00:09:00.496867 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:00.496868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:00.496876 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:00.496924 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:00.497452 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.497952 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.498856 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.499030 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.499078 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.499718 (+ 640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:00.499719 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:00.499719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:00.499723 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:00.499735 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:00.499738 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:00.499775 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:00.499852 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 00:09:00.499874 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:09:00.500092 8116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.496231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:40595 (local address 127.19.59.67:58579)
0812 00:09:00.496390 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:00.496422 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:00.496799 (+ 377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:00.496964 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:00.496967 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:00.496973 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:00.497363 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.497366 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.498043 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.498043 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.498786 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.498788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.499095 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.499096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.499188 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.499593 (+ 405us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:09:00.499593 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:00.499616 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:09:00.499634 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:00.499775 (+ 141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:00.499777 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:00.499778 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 00:09:00.499835 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 00:09:00.499903 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":82,"threads_started":1}
I20260812 00:09:00.500607 8114 heartbeater.cc:347] Connected to a master server at 127.19.59.126:40595
I20260812 00:09:00.500699 8114 heartbeater.cc:464] Registering TS with master...
I20260812 00:09:00.500824 8114 heartbeater.cc:511] Master 127.19.59.126:40595 requested a full tablet report, sending...
I20260812 00:09:00.501185 7587 ts_manager.cc:194] Registered new tserver with Master: 5dd038f684d2459788953b0e8589929f (127.19.59.67:43187)
I20260812 00:09:00.501407 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 7968
I20260812 00:09:00.501529 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:09:00.501657 7587 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.59.67:58579
I20260812 00:09:00.501729 19693 external_mini_cluster.cc:1428] Setting key a3c724ec9b1d5ed782d3ea726f8ab63c
I20260812 00:09:00.502593 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:09:00.506430 7651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.503956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40706 (local address 127.19.59.126:40595)
0812 00:09:00.504040 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:00.504042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:00.504054 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:09:00.504115 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:00.504116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:00.504124 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:00.504166 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:00.504338 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.504780 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.505447 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.505615 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.505672 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.506219 (+ 547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:00.506220 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:00.506220 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:00.506224 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:00.506234 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:00.506237 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:00.506277 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:00.506319 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 00:09:00.506336 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 00:09:00.507823 7587 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40706:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:09:00.509334 7587 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:09:00.514954 8125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.511457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46544 (local address 127.19.59.67:43187)
0812 00:09:00.511752 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:00.511755 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:00.511765 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:09:00.511794 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:00.511795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:00.511806 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:00.511886 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:00.512044 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.512841 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.513903 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.514582 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.514686 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.514759 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:00.514853 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 00:09:00.514887 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":95,"threads_started":1}
I20260812 00:09:00.514961 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.511313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:43187 (local address 127.0.0.1:46544)
0812 00:09:00.511566 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:00.511576 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:00.511637 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:00.511898 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:00.511900 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:00.511902 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:00.511958 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.511960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.512921 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.512922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.513777 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.513779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.514690 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.514691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.514761 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.514772 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:09:00.514841 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 00:09:00.514885 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":90,"threads_started":1}
I20260812 00:09:00.515316 8122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.511304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:45193 (local address 127.0.0.1:50966)
0812 00:09:00.511405 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:00.511437 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:00.511497 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:00.511973 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:00.511974 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:00.511975 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:00.512007 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.512008 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.513237 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.513238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.514265 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.514268 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.515119 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.515120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.515187 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.515192 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:09:00.515220 (+ 28us) client_negotiation.cc:240] Negotiation successful
0812 00:09:00.515255 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":57,"threads_started":1}
I20260812 00:09:00.515552 8123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.511329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:36709 (local address 127.0.0.1:37238)
0812 00:09:00.511568 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:00.511576 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:00.511637 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:00.512368 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:00.512369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:00.512371 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:00.512405 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.512406 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.513663 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.513664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.514554 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.514556 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.515338 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.515339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.515396 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.515400 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:09:00.515459 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 00:09:00.515494 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":84,"threads_started":1}
I20260812 00:09:00.515592 8128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.511857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37238 (local address 127.19.59.66:36709)
0812 00:09:00.512172 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:00.512176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:00.512184 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:09:00.512217 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:00.512219 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:00.512233 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:00.512301 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:00.512479 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.513573 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.514633 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.515242 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.515333 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.515411 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:00.515472 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 00:09:00.515513 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":85,"threads_started":1}
I20260812 00:09:00.515677 8127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.511662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50966 (local address 127.19.59.65:45193)
0812 00:09:00.511820 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:00.511824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:00.511835 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:09:00.511873 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:00.511875 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:00.511889 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:00.511964 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:00.512067 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.513136 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.514360 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.515015 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.515464 (+ 449us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.515550 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:00.515574 (+ 24us) server_negotiation.cc:299] Negotiation successful
0812 00:09:00.515607 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260812 00:09:00.515872 8037 tablet_service.cc:1467] Processing CreateTablet for tablet ee7697cd99b6450f9d0f60018db61e0d (DEFAULT_TABLE table=test-table [id=d6c7d24a095641a4a9bfbd9e991b1750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:09:00.516223 8037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee7697cd99b6450f9d0f60018db61e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:00.516340 7734 tablet_service.cc:1467] Processing CreateTablet for tablet ee7697cd99b6450f9d0f60018db61e0d (DEFAULT_TABLE table=test-table [id=d6c7d24a095641a4a9bfbd9e991b1750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:09:00.516628 7734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee7697cd99b6450f9d0f60018db61e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:00.518424 7886 tablet_service.cc:1467] Processing CreateTablet for tablet ee7697cd99b6450f9d0f60018db61e0d (DEFAULT_TABLE table=test-table [id=d6c7d24a095641a4a9bfbd9e991b1750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:09:00.518712 7886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee7697cd99b6450f9d0f60018db61e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:00.519595 8129 tablet_bootstrap.cc:492] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f: Bootstrap starting.
I20260812 00:09:00.520092 8130 tablet_bootstrap.cc:492] T ee7697cd99b6450f9d0f60018db61e0d P d5b09ee92a074479b52bcc5217a50103: Bootstrap starting.
I20260812 00:09:00.520231 8129 tablet_bootstrap.cc:654] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:00.520550 8129 log.cc:824] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:00.520678 8130 tablet_bootstrap.cc:654] T ee7697cd99b6450f9d0f60018db61e0d P d5b09ee92a074479b52bcc5217a50103: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:00.521039 8130 log.cc:824] T ee7697cd99b6450f9d0f60018db61e0d P d5b09ee92a074479b52bcc5217a50103: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:00.521266 8129 tablet_bootstrap.cc:492] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f: No bootstrap required, opened a new log
I20260812 00:09:00.521340 8129 ts_tablet_manager.cc:1397] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:09:00.521768 8130 tablet_bootstrap.cc:492] T ee7697cd99b6450f9d0f60018db61e0d P d5b09ee92a074479b52bcc5217a50103: No bootstrap required, opened a new log
I20260812 00:09:00.521871 8130 ts_tablet_manager.cc:1397] T ee7697cd99b6450f9d0f60018db61e0d P d5b09ee92a074479b52bcc5217a50103: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:09:00.522045 8133 tablet_bootstrap.cc:492] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02: Bootstrap starting.
I20260812 00:09:00.522708 8133 tablet_bootstrap.cc:654] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:00.523074 8133 log.cc:824] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:00.523826 8133 tablet_bootstrap.cc:492] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02: No bootstrap required, opened a new log
I20260812 00:09:00.523911 8133 ts_tablet_manager.cc:1397] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:09:00.524148 8130 raft_consensus.cc:348] T ee7697cd99b6450f9d0f60018db61e0d P d5b09ee92a074479b52bcc5217a50103 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5b09ee92a074479b52bcc5217a50103" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45193 } } peers { permanent_uuid: "5dd038f684d2459788953b0e8589929f" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 43187 } } peers { permanent_uuid: "355bd2cd82fc4b5488640c34a4662b02" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36709 } }
I20260812 00:09:00.524129 8129 raft_consensus.cc:348] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5b09ee92a074479b52bcc5217a50103" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45193 } } peers { permanent_uuid: "5dd038f684d2459788953b0e8589929f" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 43187 } } peers { permanent_uuid: "355bd2cd82fc4b5488640c34a4662b02" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36709 } }
I20260812 00:09:00.524278 8129 raft_consensus.cc:374] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:00.524279 8130 raft_consensus.cc:374] T ee7697cd99b6450f9d0f60018db61e0d P d5b09ee92a074479b52bcc5217a50103 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:00.524317 8130 raft_consensus.cc:729] T ee7697cd99b6450f9d0f60018db61e0d P d5b09ee92a074479b52bcc5217a50103 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b09ee92a074479b52bcc5217a50103, State: Initialized, Role: FOLLOWER
I20260812 00:09:00.524350 8129 raft_consensus.cc:729] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dd038f684d2459788953b0e8589929f, State: Initialized, Role: FOLLOWER
I20260812 00:09:00.524444 8130 consensus_queue.cc:260] T ee7697cd99b6450f9d0f60018db61e0d P d5b09ee92a074479b52bcc5217a50103 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5b09ee92a074479b52bcc5217a50103" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45193 } } peers { permanent_uuid: "5dd038f684d2459788953b0e8589929f" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 43187 } } peers { permanent_uuid: "355bd2cd82fc4b5488640c34a4662b02" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36709 } }
I20260812 00:09:00.524497 8129 consensus_queue.cc:260] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5b09ee92a074479b52bcc5217a50103" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45193 } } peers { permanent_uuid: "5dd038f684d2459788953b0e8589929f" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 43187 } } peers { permanent_uuid: "355bd2cd82fc4b5488640c34a4662b02" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36709 } }
I20260812 00:09:00.524704 8130 ts_tablet_manager.cc:1428] T ee7697cd99b6450f9d0f60018db61e0d P d5b09ee92a074479b52bcc5217a50103: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:09:00.524820 8129 ts_tablet_manager.cc:1428] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:09:00.524858 7813 heartbeater.cc:503] Master 127.19.59.126:40595 was elected leader, sending a full tablet report...
I20260812 00:09:00.524955 8114 heartbeater.cc:503] Master 127.19.59.126:40595 was elected leader, sending a full tablet report...
I20260812 00:09:00.526324 8133 raft_consensus.cc:348] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5b09ee92a074479b52bcc5217a50103" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45193 } } peers { permanent_uuid: "5dd038f684d2459788953b0e8589929f" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 43187 } } peers { permanent_uuid: "355bd2cd82fc4b5488640c34a4662b02" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36709 } }
I20260812 00:09:00.526429 8133 raft_consensus.cc:374] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:00.526448 8133 raft_consensus.cc:729] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 355bd2cd82fc4b5488640c34a4662b02, State: Initialized, Role: FOLLOWER
I20260812 00:09:00.526582 8133 consensus_queue.cc:260] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5b09ee92a074479b52bcc5217a50103" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45193 } } peers { permanent_uuid: "5dd038f684d2459788953b0e8589929f" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 43187 } } peers { permanent_uuid: "355bd2cd82fc4b5488640c34a4662b02" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36709 } }
I20260812 00:09:00.526813 8133 ts_tablet_manager.cc:1428] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:09:00.526852 7965 heartbeater.cc:503] Master 127.19.59.126:40595 was elected leader, sending a full tablet report...
I20260812 00:09:00.558007 8137 raft_consensus.cc:482] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:09:00.558099 8137 raft_consensus.cc:504] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5b09ee92a074479b52bcc5217a50103" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45193 } } peers { permanent_uuid: "5dd038f684d2459788953b0e8589929f" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 43187 } } peers { permanent_uuid: "355bd2cd82fc4b5488640c34a4662b02" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36709 } }
I20260812 00:09:00.558377 8137 leader_election.cc:288] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5b09ee92a074479b52bcc5217a50103 (127.19.59.65:45193), 5dd038f684d2459788953b0e8589929f (127.19.59.67:43187)
I20260812 00:09:00.561496 8127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.558588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:34375 (local address 127.19.59.65:45193)
0812 00:09:00.558625 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:00.558627 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:00.558634 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:09:00.558659 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:00.558660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:00.558669 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:00.558716 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:00.558894 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.559377 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.560801 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.561156 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.561239 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.561248 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:00.561387 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 00:09:00.561423 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:09:00.561543 7967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.558515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:45193 (local address 127.19.59.66:34375)
0812 00:09:00.558563 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:00.558574 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:00.558612 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:00.558733 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:00.558734 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:00.558736 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:00.558811 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.558813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.559505 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.559506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.560719 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.560721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.561239 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.561240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.561306 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.561309 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:09:00.561382 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 00:09:00.561423 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":2}
I20260812 00:09:00.561535 8125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.558724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:34327 (local address 127.19.59.67:43187)
0812 00:09:00.558769 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:00.558770 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:00.558782 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:09:00.558809 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:00.558810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:00.558820 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:00.558872 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:00.559027 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.559521 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.560826 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.561187 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.561269 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.561277 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:00.561431 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 00:09:00.561469 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:09:00.561582 8138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.558529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:43187 (local address 127.19.59.66:34327)
0812 00:09:00.558714 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:00.558723 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:00.558758 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:00.558893 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:00.558894 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:00.558895 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:00.558958 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.558960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.559603 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.559604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.560733 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:00.560735 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.561269 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.561270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:00.561343 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.561345 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:09:00.561421 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 00:09:00.561459 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":1,"thread_start_us":102,"threads_started":1}
I20260812 00:09:00.561934 7756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee7697cd99b6450f9d0f60018db61e0d" candidate_uuid: "355bd2cd82fc4b5488640c34a4662b02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b09ee92a074479b52bcc5217a50103" is_pre_election: true
I20260812 00:09:00.562115 7756 raft_consensus.cc:2454] T ee7697cd99b6450f9d0f60018db61e0d P d5b09ee92a074479b52bcc5217a50103 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 355bd2cd82fc4b5488640c34a4662b02 in term 0.
I20260812 00:09:00.562132 8058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee7697cd99b6450f9d0f60018db61e0d" candidate_uuid: "355bd2cd82fc4b5488640c34a4662b02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dd038f684d2459788953b0e8589929f" is_pre_election: true
I20260812 00:09:00.562270 8058 raft_consensus.cc:2454] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 355bd2cd82fc4b5488640c34a4662b02 in term 0.
I20260812 00:09:00.562359 7837 leader_election.cc:302] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 355bd2cd82fc4b5488640c34a4662b02, d5b09ee92a074479b52bcc5217a50103; no voters:
I20260812 00:09:00.562510 8137 raft_consensus.cc:2781] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:09:00.562566 8137 raft_consensus.cc:482] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:09:00.562599 8137 raft_consensus.cc:3037] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:00.563261 8137 raft_consensus.cc:504] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5b09ee92a074479b52bcc5217a50103" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45193 } } peers { permanent_uuid: "5dd038f684d2459788953b0e8589929f" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 43187 } } peers { permanent_uuid: "355bd2cd82fc4b5488640c34a4662b02" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36709 } }
I20260812 00:09:00.563395 8137 leader_election.cc:288] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [CANDIDATE]: Term 1 election: Requested vote from peers d5b09ee92a074479b52bcc5217a50103 (127.19.59.65:45193), 5dd038f684d2459788953b0e8589929f (127.19.59.67:43187)
I20260812 00:09:00.563534 7756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee7697cd99b6450f9d0f60018db61e0d" candidate_uuid: "355bd2cd82fc4b5488640c34a4662b02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b09ee92a074479b52bcc5217a50103"
I20260812 00:09:00.563560 8058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee7697cd99b6450f9d0f60018db61e0d" candidate_uuid: "355bd2cd82fc4b5488640c34a4662b02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dd038f684d2459788953b0e8589929f"
I20260812 00:09:00.563608 7756 raft_consensus.cc:3037] T ee7697cd99b6450f9d0f60018db61e0d P d5b09ee92a074479b52bcc5217a50103 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:00.563644 8058 raft_consensus.cc:3037] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:00.564282 7756 raft_consensus.cc:2454] T ee7697cd99b6450f9d0f60018db61e0d P d5b09ee92a074479b52bcc5217a50103 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 355bd2cd82fc4b5488640c34a4662b02 in term 1.
I20260812 00:09:00.564400 8058 raft_consensus.cc:2454] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 355bd2cd82fc4b5488640c34a4662b02 in term 1.
I20260812 00:09:00.564438 7837 leader_election.cc:302] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 355bd2cd82fc4b5488640c34a4662b02, d5b09ee92a074479b52bcc5217a50103; no voters:
I20260812 00:09:00.564551 8137 raft_consensus.cc:2781] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:00.564713 8137 raft_consensus.cc:686] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [term 1 LEADER]: Becoming Leader. State: Replica: 355bd2cd82fc4b5488640c34a4662b02, State: Running, Role: LEADER
I20260812 00:09:00.564808 8137 consensus_queue.cc:237] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5b09ee92a074479b52bcc5217a50103" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45193 } } peers { permanent_uuid: "5dd038f684d2459788953b0e8589929f" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 43187 } } peers { permanent_uuid: "355bd2cd82fc4b5488640c34a4662b02" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36709 } }
I20260812 00:09:00.565579 7587 catalog_manager.cc:5495] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 reported cstate change: term changed from 0 to 1, leader changed from <none> to 355bd2cd82fc4b5488640c34a4662b02 (127.19.59.66). New cstate: current_term: 1 leader_uuid: "355bd2cd82fc4b5488640c34a4662b02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5b09ee92a074479b52bcc5217a50103" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd038f684d2459788953b0e8589929f" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "355bd2cd82fc4b5488640c34a4662b02" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36709 } health_report { overall_health: HEALTHY } } }
I20260812 00:09:00.574393 8128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.572288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37254 (local address 127.19.59.66:36709)
0812 00:09:00.572344 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:00.572346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:00.572353 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:09:00.572400 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:00.572401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:00.572414 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:00.572476 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:09:00.572576 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.573004 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.573693 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:00.573936 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:00.573988 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:00.574114 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:09:00.574199 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:09:00.574256 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:00.574267 (+ 11us) server_negotiation.cc:299] Negotiation successful
0812 00:09:00.574280 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:09:00.575969 8058 raft_consensus.cc:1261] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f [term 1 FOLLOWER]: Refusing update from remote peer 355bd2cd82fc4b5488640c34a4662b02: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:09:00.575969 7756 raft_consensus.cc:1261] T ee7697cd99b6450f9d0f60018db61e0d P d5b09ee92a074479b52bcc5217a50103 [term 1 FOLLOWER]: Refusing update from remote peer 355bd2cd82fc4b5488640c34a4662b02: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:09:00.576303 8137 consensus_queue.cc:1035] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b09ee92a074479b52bcc5217a50103" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:09:00.576439 8139 consensus_queue.cc:1035] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd038f684d2459788953b0e8589929f" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:09:00.578831 8142 mvcc.cc:205] Tried to move back new op lower bound from 7317476722996916224 to 7317476722954096640. Current Snapshot: MvccSnapshot[applied={T|T < 7317476722996916224}]
I20260812 00:09:00.579005 8143 mvcc.cc:205] Tried to move back new op lower bound from 7317476722996916224 to 7317476722954096640. Current Snapshot: MvccSnapshot[applied={T|T < 7317476722996916224}]
I20260812 00:09:00.579455 8144 mvcc.cc:205] Tried to move back new op lower bound from 7317476722996916224 to 7317476722954096640. Current Snapshot: MvccSnapshot[applied={T|T < 7317476722996916224}]
I20260812 00:09:00.581398 7587 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:09:00.581491 7587 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:09:00.582206 7587 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 44050357cbab49c6abe081b60b3d72d6: Sending DeleteTablet for 3 replicas of tablet ee7697cd99b6450f9d0f60018db61e0d
I20260812 00:09:00.582540 7886 tablet_service.cc:1514] Processing DeleteTablet for tablet ee7697cd99b6450f9d0f60018db61e0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:00 UTC) from {username='slave'} at 127.0.0.1:37238
I20260812 00:09:00.582561 8037 tablet_service.cc:1514] Processing DeleteTablet for tablet ee7697cd99b6450f9d0f60018db61e0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:00 UTC) from {username='slave'} at 127.0.0.1:46544
I20260812 00:09:00.582571 7734 tablet_service.cc:1514] Processing DeleteTablet for tablet ee7697cd99b6450f9d0f60018db61e0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:00 UTC) from {username='slave'} at 127.0.0.1:50966
I20260812 00:09:00.582783 8154 tablet_replica.cc:330] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02: stopping tablet replica
I20260812 00:09:00.582880 8154 raft_consensus.cc:2229] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:09:00.583014 8154 raft_consensus.cc:2258] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:09:00.583055 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 7652
I20260812 00:09:00.582904 8155 tablet_replica.cc:330] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f: stopping tablet replica
I20260812 00:09:00.583252 8155 raft_consensus.cc:2229] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:09:00.586489 8154 ts_tablet_manager.cc:1905] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:09:00.587500 8155 raft_consensus.cc:2258] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:09:00.588012 8155 ts_tablet_manager.cc:1905] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:09:00.588512 8154 ts_tablet_manager.cc:1918] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:09:00.588587 8154 log.cc:1196] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/ee7697cd99b6450f9d0f60018db61e0d
I20260812 00:09:00.588831 8154 ts_tablet_manager.cc:1939] T ee7697cd99b6450f9d0f60018db61e0d P 355bd2cd82fc4b5488640c34a4662b02: Deleting consensus metadata
I20260812 00:09:00.589241 7568 catalog_manager.cc:4841] TS 355bd2cd82fc4b5488640c34a4662b02 (127.19.59.66:36709): tablet ee7697cd99b6450f9d0f60018db61e0d (table test-table [id=d6c7d24a095641a4a9bfbd9e991b1750]) successfully deleted
I20260812 00:09:00.589844 8155 ts_tablet_manager.cc:1918] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:09:00.589913 8155 log.cc:1196] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/ee7697cd99b6450f9d0f60018db61e0d
I20260812 00:09:00.590147 8155 ts_tablet_manager.cc:1939] T ee7697cd99b6450f9d0f60018db61e0d P 5dd038f684d2459788953b0e8589929f: Deleting consensus metadata
I20260812 00:09:00.590516 7567 catalog_manager.cc:4841] TS 5dd038f684d2459788953b0e8589929f (127.19.59.67:43187): tablet ee7697cd99b6450f9d0f60018db61e0d (table test-table [id=d6c7d24a095641a4a9bfbd9e991b1750]) successfully deleted
W20260812 00:09:00.593798 7570 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:45193 (error 108)
I20260812 00:09:00.594372 8123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:00.594237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:45193 (local address 127.0.0.1:50974)
0812 00:09:00.594296 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:00.594335 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:45193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 00:09:00.594437 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 7816
W20260812 00:09:00.596962 7570 catalog_manager.cc:4584] TS d5b09ee92a074479b52bcc5217a50103 (127.19.59.65:45193): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ee7697cd99b6450f9d0f60018db61e0d: Network error: Client connection negotiation failed: client connection to 127.19.59.65:45193: connect: Connection refused (error 111)
I20260812 00:09:00.602447 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 7968
I20260812 00:09:00.607832 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 7548
2026-08-12T00:09:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (637 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:00 dist-test-slave-6nmv krb5kdc[8160](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:00 dist-test-slave-6nmv krb5kdc[8160](info): set up 2 sockets
Aug 12 00:09:00 dist-test-slave-6nmv krb5kdc[8160](info): commencing operation
krb5kdc: starting...
W20260812 00:09:01.651674 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.022s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:01 dist-test-slave-6nmv krb5kdc[8160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:09:01.762799 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:35457
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:35457
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:01.841089 8173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:01.841331 8173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:01.841382 8173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:01.842687 8173 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:01.842773 8173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:01.842819 8173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:01.842852 8173 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:01.842909 8173 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:01.844437 8173 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:35457
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:35457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:01.844688 8173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:01.844913 8173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:01.849088 8181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:01.849193 8173 server_base.cc:1034] running on GCE node
W20260812 00:09:01.849093 8179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:01.849120 8178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:01.849596 8173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:01.849924 8173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:01.851063 8173 hybrid_clock.cc:648] HybridClock initialized: now 1786493341851048 us; error 29 us; skew 500 ppm
Aug 12 00:09:01 dist-test-slave-6nmv krb5kdc[8160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493341, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:01.853535 8173 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:09:01.854044 8173 webserver.cc:460] Webserver started at http://127.19.59.126:34447/ using document root <none> and password file <none>
I20260812 00:09:01.854235 8173 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:01.854274 8173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:01.854358 8173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:01.855242 8173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "22e08a8680c04c9abe4595e7865a07d4"
format_stamp: "Formatted at 2026-08-12 00:09:01 on dist-test-slave-6nmv"
server_key: "0909e2a3da98f351577af1b5b83b2585"
server_key_iv: "d186086e87938c39c8abfef457c222cc"
server_key_version: "encryptionkey@0"
I20260812 00:09:01.855530 8173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "22e08a8680c04c9abe4595e7865a07d4"
format_stamp: "Formatted at 2026-08-12 00:09:01 on dist-test-slave-6nmv"
server_key: "0909e2a3da98f351577af1b5b83b2585"
server_key_iv: "d186086e87938c39c8abfef457c222cc"
server_key_version: "encryptionkey@0"
I20260812 00:09:01.856698 8173 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:09:01.857338 8189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:01.857511 8173 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:01.857605 8173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "22e08a8680c04c9abe4595e7865a07d4"
format_stamp: "Formatted at 2026-08-12 00:09:01 on dist-test-slave-6nmv"
server_key: "0909e2a3da98f351577af1b5b83b2585"
server_key_iv: "d186086e87938c39c8abfef457c222cc"
server_key_version: "encryptionkey@0"
I20260812 00:09:01.857682 8173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:01.878473 8173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:01.880767 8173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:01.881047 8173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:01.885238 8173 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:35457
I20260812 00:09:01.885275 8252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:35457 every 8 connection(s)
I20260812 00:09:01.885620 8173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:01.886490 8253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:01.887475 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 8173
I20260812 00:09:01.887619 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:01.887836 19693 external_mini_cluster.cc:1428] Setting key 2323c889f0b2d97b7d50db9f92110faf
I20260812 00:09:01.889333 8253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4: Bootstrap starting.
I20260812 00:09:01.889956 8253 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:01.890285 8253 log.cc:824] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:01.890987 8253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4: No bootstrap required, opened a new log
I20260812 00:09:01.893195 8253 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e08a8680c04c9abe4595e7865a07d4" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35457 } }
I20260812 00:09:01.893337 8253 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:01.893360 8253 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22e08a8680c04c9abe4595e7865a07d4, State: Initialized, Role: FOLLOWER
I20260812 00:09:01.893496 8253 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e08a8680c04c9abe4595e7865a07d4" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35457 } }
I20260812 00:09:01.893574 8253 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:01.893596 8253 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:01.893667 8253 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:01.894285 8253 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e08a8680c04c9abe4595e7865a07d4" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35457 } }
I20260812 00:09:01.894372 8253 leader_election.cc:302] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22e08a8680c04c9abe4595e7865a07d4; no voters:
I20260812 00:09:01.894573 8253 leader_election.cc:288] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:01.894606 8259 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:01.894717 8259 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [term 1 LEADER]: Becoming Leader. State: Replica: 22e08a8680c04c9abe4595e7865a07d4, State: Running, Role: LEADER
I20260812 00:09:01.894827 8253 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [sys.catalog]: configured and running, proceeding with master startup.
Aug 12 00:09:01 dist-test-slave-6nmv krb5kdc[8160](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:01.894863 8259 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e08a8680c04c9abe4595e7865a07d4" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35457 } }
I20260812 00:09:01.895185 8259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22e08a8680c04c9abe4595e7865a07d4. Latest consensus state: current_term: 1 leader_uuid: "22e08a8680c04c9abe4595e7865a07d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e08a8680c04c9abe4595e7865a07d4" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35457 } } }
I20260812 00:09:01.895305 8259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:01.895198 8261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22e08a8680c04c9abe4595e7865a07d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e08a8680c04c9abe4595e7865a07d4" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35457 } } }
I20260812 00:09:01.895426 8261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:01.895598 8264 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:01.896656 8264 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:01.898154 8264 catalog_manager.cc:1347] Generated new cluster ID: ae2e68a6f2404d5897c8c4547da8e6cb
I20260812 00:09:01.898221 8264 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:01.899020 8257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:01.888370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48846 (local address 127.19.59.126:35457)
0812 00:09:01.888568 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:01.888578 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:01.888611 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:09:01.889102 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:01.889111 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:01.889168 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:01.889317 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:01.889955 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:01.891187 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:01.891928 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:01.892565 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:01.892692 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:01.895442 (+ 2750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:01.895446 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:01.895446 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:01.895458 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:01.897368 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:01.897763 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:01.897766 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:01.897766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:01.897899 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:01.898146 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:01.898147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:01.898147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:01.898439 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:01.898572 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:01.898731 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 00:09:01.898849 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":82,"threads_started":1}
I20260812 00:09:01.903406 8264 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:01.904098 8264 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:01.913127 8264 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4: Generated new TSK 0
I20260812 00:09:01.913280 8264 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:09:01.942556 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35457
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:02.020467 8282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:02.020648 8282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:02.020668 8282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:02.021649 8282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:02.021680 8282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:02.021703 8282 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:09:02.023064 8282 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8282
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:02.023252 8282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:02.023425 8282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:02.027977 8289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:02.027956 8291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:02.028051 8282 server_base.cc:1034] running on GCE node
W20260812 00:09:02.028002 8288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:02.028406 8282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:02.028594 8282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:02.029732 8282 hybrid_clock.cc:648] HybridClock initialized: now 1786493342029714 us; error 34 us; skew 500 ppm
Aug 12 00:09:02 dist-test-slave-6nmv krb5kdc[8160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493342, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:02.032305 8282 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:09:02.032799 8282 webserver.cc:460] Webserver started at http://127.19.59.65:41897/ using document root <none> and password file <none>
I20260812 00:09:02.033052 8282 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:02.033123 8282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:02.033275 8282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:02.034346 8282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "d23be7cad8e1498197db9a670d1b6ed0"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "4f67fe411d942928bf193a7a1e953b1b"
server_key_iv: "fbddbe0f69f7af0902cf86e87353560d"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.034735 8282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "d23be7cad8e1498197db9a670d1b6ed0"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "4f67fe411d942928bf193a7a1e953b1b"
server_key_iv: "fbddbe0f69f7af0902cf86e87353560d"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.036063 8282 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:09:02.036813 8299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.036975 8282 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:02.037078 8282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "d23be7cad8e1498197db9a670d1b6ed0"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "4f67fe411d942928bf193a7a1e953b1b"
server_key_iv: "fbddbe0f69f7af0902cf86e87353560d"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.037149 8282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:02.056728 8282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:02.058404 8282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:02.058573 8282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:02.058775 8282 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:09:02.059077 8282 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:09:02.059131 8282 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.059172 8282 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:09:02.059201 8282 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.065326 8282 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:45065
I20260812 00:09:02.065372 8428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:45065 every 8 connection(s)
I20260812 00:09:02.065636 8282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:09:02.066958 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 8282
I20260812 00:09:02.067082 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:09:02.067296 19693 external_mini_cluster.cc:1428] Setting key 654dd46b37be03029533105034bf1131
Aug 12 00:09:02 dist-test-slave-6nmv krb5kdc[8160](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493342, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:02.075649 8431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.066242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:35457 (local address 127.19.59.65:34551)
0812 00:09:02.066406 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:02.066442 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:02.066860 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:02.067149 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:02.067153 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:02.067877 (+ 724us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:02.068112 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.068120 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.068732 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.068733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.069940 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.069944 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.070475 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.070476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.070570 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.071064 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:02.071071 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:02.072466 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:02.074379 (+ 1913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:02.074385 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:02.074386 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:02.074628 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:02.074839 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:02.074840 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:02.074840 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:02.074932 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:02.075207 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:02.075212 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:02.075313 (+ 101us) client_negotiation.cc:769] Sending connection context
0812 00:09:02.075389 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 00:09:02.075503 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
I20260812 00:09:02.075661 8257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.066294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:34551 (local address 127.19.59.126:35457)
0812 00:09:02.066351 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:02.066353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:02.066521 (+ 168us) server_negotiation.cc:407] Connection header received
0812 00:09:02.066977 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:02.066978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:02.066990 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:02.067045 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:02.068197 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.068643 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.070030 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.070360 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.070454 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.072558 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:02.072560 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:02.072560 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:02.072575 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:02.074304 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:02.074706 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:02.074707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:02.074707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:02.074772 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:02.074999 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:02.075001 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:02.075001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:02.075141 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:02.075213 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:02.075439 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 00:09:02.075538 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:09:02.076256 8429 heartbeater.cc:347] Connected to a master server at 127.19.59.126:35457
I20260812 00:09:02.076371 8429 heartbeater.cc:464] Registering TS with master...
I20260812 00:09:02.076557 8429 heartbeater.cc:511] Master 127.19.59.126:35457 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
I20260812 00:09:02.077190 8207 ts_manager.cc:194] Registered new tserver with Master: d23be7cad8e1498197db9a670d1b6ed0 (127.19.59.65:45065)
I20260812 00:09:02.077894 8207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:34551
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:09:02.094919 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35457
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:02.175293 8435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:02.175472 8435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:02.175493 8435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:02.176441 8435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:02.176471 8435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:02.176494 8435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:09:02.177690 8435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:02.177914 8435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:02.178081 8435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:02.182873 8443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:02.182888 8441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:02.182883 8440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:02.183482 8435 server_base.cc:1034] running on GCE node
I20260812 00:09:02.183683 8435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:02.183909 8435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:02.185081 8435 hybrid_clock.cc:648] HybridClock initialized: now 1786493342185084 us; error 40 us; skew 500 ppm
Aug 12 00:09:02 dist-test-slave-6nmv krb5kdc[8160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493342, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:02.187353 8435 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:09:02.187750 8435 webserver.cc:460] Webserver started at http://127.19.59.66:40331/ using document root <none> and password file <none>
I20260812 00:09:02.187958 8435 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:02.188017 8435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:02.188145 8435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:02.188995 8435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "8481f3c176784869ba5ae92b1c39d13b"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "92e804ab18407b887bd1d87d4a6dc293"
server_key_iv: "d1551a30ec168f23a8c0d00418f55ece"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.189306 8435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "8481f3c176784869ba5ae92b1c39d13b"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "92e804ab18407b887bd1d87d4a6dc293"
server_key_iv: "d1551a30ec168f23a8c0d00418f55ece"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.190644 8435 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:09:02.191335 8452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.191481 8435 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:02.191571 8435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "8481f3c176784869ba5ae92b1c39d13b"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "92e804ab18407b887bd1d87d4a6dc293"
server_key_iv: "d1551a30ec168f23a8c0d00418f55ece"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.191669 8435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:02.201874 8435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:02.203483 8435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:02.203631 8435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:02.203846 8435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:09:02.204227 8435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:09:02.204298 8435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.204334 8435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:09:02.204399 8435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.209734 8435 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:36859
I20260812 00:09:02.209779 8584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:36859 every 8 connection(s)
I20260812 00:09:02.210104 8435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:09:02 dist-test-slave-6nmv krb5kdc[8160](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493342, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:02.218240 8257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.210694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:43179 (local address 127.19.59.126:35457)
0812 00:09:02.210770 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:02.210772 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:02.210920 (+ 148us) server_negotiation.cc:407] Connection header received
0812 00:09:02.211348 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:02.211349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:02.211362 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:02.211407 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:02.212313 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.212810 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.213779 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.214047 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.214126 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.215875 (+ 1749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:02.215877 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:02.215877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:02.215885 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:02.216974 (+ 1089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:02.217346 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:02.217347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:02.217347 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:02.217407 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:02.217646 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:02.217647 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:02.217647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:02.217758 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:02.217851 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:02.218088 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 00:09:02.218161 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:09:02.218410 8587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.210662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:35457 (local address 127.19.59.66:43179)
0812 00:09:02.210821 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:02.210849 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:02.211247 (+ 398us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:02.211464 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:02.211467 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:02.212041 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:02.212206 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.212210 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.212925 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.212926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.213685 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.213687 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.214136 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.214137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.214239 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.214680 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:02.214687 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:02.215787 (+ 1100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:02.217071 (+ 1284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:02.217077 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:02.217079 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:02.217275 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:02.217476 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:02.217477 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:02.217477 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:02.217577 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:02.217842 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:02.217849 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:02.217964 (+ 115us) client_negotiation.cc:769] Sending connection context
0812 00:09:02.218067 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 00:09:02.218193 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":76,"threads_started":1}
I20260812 00:09:02.218812 8585 heartbeater.cc:347] Connected to a master server at 127.19.59.126:35457
I20260812 00:09:02.218897 8585 heartbeater.cc:464] Registering TS with master...
I20260812 00:09:02.219045 8585 heartbeater.cc:511] Master 127.19.59.126:35457 requested a full tablet report, sending...
I20260812 00:09:02.219367 8207 ts_manager.cc:194] Registered new tserver with Master: 8481f3c176784869ba5ae92b1c39d13b (127.19.59.66:36859)
I20260812 00:09:02.219657 8207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:43179
I20260812 00:09:02.220101 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 8435
I20260812 00:09:02.220198 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:09:02.220381 19693 external_mini_cluster.cc:1428] Setting key b8c22e81326a51a251fbf2576047e8b9
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:09:02.244632 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35457
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:02.320513 8591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:02.320711 8591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:02.320746 8591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:02.321903 8591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:02.321969 8591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:02.322009 8591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:09:02.323450 8591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:02.323714 8591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:02.323933 8591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:02.328455 8597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:02.328509 8591 server_base.cc:1034] running on GCE node
W20260812 00:09:02.328464 8601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:02.328471 8598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:02.328778 8591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:02.329006 8591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:02.330157 8591 hybrid_clock.cc:648] HybridClock initialized: now 1786493342330158 us; error 34 us; skew 500 ppm
Aug 12 00:09:02 dist-test-slave-6nmv krb5kdc[8160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493342, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:02.332453 8591 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:09:02.332901 8591 webserver.cc:460] Webserver started at http://127.19.59.67:44867/ using document root <none> and password file <none>
I20260812 00:09:02.333123 8591 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:02.333192 8591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:02.333326 8591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:02.334338 8591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "d1d6bda086534f6ea55d92824229beb7"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "fcf91e61692ca5588ad882c6e00a38b6"
server_key_iv: "e03540f3deed18cde83231d6701e3c73"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.334652 8591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "d1d6bda086534f6ea55d92824229beb7"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "fcf91e61692ca5588ad882c6e00a38b6"
server_key_iv: "e03540f3deed18cde83231d6701e3c73"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.335798 8591 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:09:02.336588 8608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.336777 8591 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:09:02.336876 8591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "d1d6bda086534f6ea55d92824229beb7"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "fcf91e61692ca5588ad882c6e00a38b6"
server_key_iv: "e03540f3deed18cde83231d6701e3c73"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.336958 8591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:02.346581 8591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:02.348084 8591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:02.348229 8591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:02.348423 8591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:09:02.348701 8591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:09:02.348762 8591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.348800 8591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:09:02.348834 8591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.354373 8591 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:45355
I20260812 00:09:02.354411 8737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:45355 every 8 connection(s)
I20260812 00:09:02.354661 8591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:09:02.358942 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 8591
I20260812 00:09:02.359036 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:09:02.359200 19693 external_mini_cluster.cc:1428] Setting key d6d3344b43068f72a0f2a8ecca20129c
Aug 12 00:09:02 dist-test-slave-6nmv krb5kdc[8160](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493342, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:02.362591 8257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.355231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:51381 (local address 127.19.59.126:35457)
0812 00:09:02.355271 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:02.355272 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:02.355413 (+ 141us) server_negotiation.cc:407] Connection header received
0812 00:09:02.355779 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:02.355781 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:02.355789 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:02.355833 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:02.356545 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.357011 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.357862 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.358033 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.358083 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.360273 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:02.360275 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:02.360275 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:02.360282 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:02.361433 (+ 1151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:02.361735 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:02.361735 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:02.361736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:02.361780 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:02.362104 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:02.362105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:02.362105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:02.362202 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:02.362251 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:02.362450 (+ 199us) server_negotiation.cc:299] Negotiation successful
0812 00:09:02.362517 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:09:02.362722 8741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.355198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:35457 (local address 127.19.59.67:51381)
0812 00:09:02.355329 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:02.355357 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:02.355708 (+ 351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:02.355874 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:02.355876 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:02.356322 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:02.356469 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.356472 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.357089 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.357090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.357759 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.357761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.358112 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.358113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.358204 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.358639 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:02.358645 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:02.360178 (+ 1533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:02.361492 (+ 1314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:02.361497 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:02.361498 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:02.361677 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:02.361875 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:02.361876 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:02.361876 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:02.362015 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:02.362253 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:02.362257 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:02.362351 (+ 94us) client_negotiation.cc:769] Sending connection context
0812 00:09:02.362424 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 00:09:02.362525 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":80,"threads_started":1}
I20260812 00:09:02.363215 8739 heartbeater.cc:347] Connected to a master server at 127.19.59.126:35457
I20260812 00:09:02.363302 8739 heartbeater.cc:464] Registering TS with master...
I20260812 00:09:02.363471 8739 heartbeater.cc:511] Master 127.19.59.126:35457 requested a full tablet report, sending...
I20260812 00:09:02.363819 8207 ts_manager.cc:194] Registered new tserver with Master: d1d6bda086534f6ea55d92824229beb7 (127.19.59.67:45355)
I20260812 00:09:02.364190 8207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:51381
I20260812 00:09:02.370926 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:09:02.377998 8257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.372187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48852 (local address 127.19.59.126:35457)
0812 00:09:02.372222 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:02.372224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:02.372338 (+ 114us) server_negotiation.cc:407] Connection header received
0812 00:09:02.372411 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:02.372412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:02.372420 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:02.372486 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:02.373057 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.373496 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.374277 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.374434 (+ 157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.374499 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.375634 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:02.375635 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:02.375636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:02.375642 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:02.376687 (+ 1045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:02.377116 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:02.377117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:02.377117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:02.377190 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:02.377430 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:02.377431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:02.377432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:02.377560 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:02.377673 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:02.377838 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 00:09:02.377902 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:09:02.379419 8207 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48852:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:09:02.380918 8207 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:09:02.387277 8750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.383092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:36859 (local address 127.0.0.1:50282)
0812 00:09:02.383602 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:02.383629 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:02.383691 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:02.383986 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:02.383989 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:02.383992 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:02.384064 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.384066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.385002 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.385003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.386111 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.386113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.386993 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.386994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.387074 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.387086 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 00:09:02.387164 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 00:09:02.387212 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":67,"threads_started":1}
I20260812 00:09:02.387291 8753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.383318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50282 (local address 127.19.59.66:36859)
0812 00:09:02.383540 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:02.383544 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:02.383703 (+ 159us) server_negotiation.cc:407] Connection header received
0812 00:09:02.383799 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:02.383802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:02.383819 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:02.383894 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:02.384147 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.384897 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.386212 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.386893 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.386989 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.387047 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:02.387185 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 00:09:02.387223 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":98,"threads_started":1}
I20260812 00:09:02.387634 8749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.383092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:45065 (local address 127.0.0.1:36002)
0812 00:09:02.383805 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:02.383814 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:02.383859 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:02.384143 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:02.384144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:02.384146 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:02.384192 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.384194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.385501 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.385502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.386474 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.386476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.387429 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.387430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.387489 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.387493 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:09:02.387535 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 00:09:02.387569 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":703,"mutex_wait_us":31,"thread_start_us":69,"threads_started":1}
I20260812 00:09:02.387928 8752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.383308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36002 (local address 127.19.59.65:45065)
0812 00:09:02.383511 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:02.383514 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:02.383867 (+ 353us) server_negotiation.cc:407] Connection header received
0812 00:09:02.383922 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:02.383925 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:02.383953 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:02.384033 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:02.384297 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.385379 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.386567 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.387273 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.387344 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.387394 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:02.387783 (+ 389us) server_negotiation.cc:299] Negotiation successful
0812 00:09:02.387850 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":85,"threads_started":1}
I20260812 00:09:02.388238 8751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.383311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32904 (local address 127.19.59.67:45355)
0812 00:09:02.383485 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:02.383490 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:02.384041 (+ 551us) server_negotiation.cc:407] Connection header received
0812 00:09:02.384080 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:02.384082 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:02.384096 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:02.384164 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:02.384299 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.385385 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.386761 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.387682 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.387745 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.387796 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:02.388122 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 00:09:02.388170 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":84,"threads_started":1}
I20260812 00:09:02.388144 8505 tablet_service.cc:1467] Processing CreateTablet for tablet 1444d86c35ec42ee9a529a5b9f27df37 (DEFAULT_TABLE table=test-table [id=2f040223429e48d1a3a3df45252f4c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:09:02.388319 8748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.383118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:45355 (local address 127.0.0.1:32904)
0812 00:09:02.383932 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:02.383940 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:02.383984 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:02.384187 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:02.384188 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:02.384190 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:02.384229 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.384230 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.385507 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.385508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.386673 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.386676 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.387844 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.387845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.387900 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.387904 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:09:02.387999 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 00:09:02.388249 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"mutex_wait_us":21,"thread_start_us":84,"threads_started":1}
I20260812 00:09:02.388509 8505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1444d86c35ec42ee9a529a5b9f27df37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:02.388597 8353 tablet_service.cc:1467] Processing CreateTablet for tablet 1444d86c35ec42ee9a529a5b9f27df37 (DEFAULT_TABLE table=test-table [id=2f040223429e48d1a3a3df45252f4c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:09:02.388974 8353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1444d86c35ec42ee9a529a5b9f27df37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:02.389386 8662 tablet_service.cc:1467] Processing CreateTablet for tablet 1444d86c35ec42ee9a529a5b9f27df37 (DEFAULT_TABLE table=test-table [id=2f040223429e48d1a3a3df45252f4c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:09:02.389681 8662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1444d86c35ec42ee9a529a5b9f27df37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:02.391772 8754 tablet_bootstrap.cc:492] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0: Bootstrap starting.
I20260812 00:09:02.392040 8755 tablet_bootstrap.cc:492] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b: Bootstrap starting.
I20260812 00:09:02.392449 8754 tablet_bootstrap.cc:654] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:02.392721 8755 tablet_bootstrap.cc:654] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:02.392912 8756 tablet_bootstrap.cc:492] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7: Bootstrap starting.
I20260812 00:09:02.393097 8754 log.cc:824] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:02.393339 8755 log.cc:824] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:02.393639 8756 tablet_bootstrap.cc:654] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:02.393920 8754 tablet_bootstrap.cc:492] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0: No bootstrap required, opened a new log
I20260812 00:09:02.393988 8754 ts_tablet_manager.cc:1397] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:09:02.394326 8756 log.cc:824] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:02.394994 8756 tablet_bootstrap.cc:492] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7: No bootstrap required, opened a new log
I20260812 00:09:02.395068 8756 ts_tablet_manager.cc:1397] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:09:02.395633 8754 raft_consensus.cc:348] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23be7cad8e1498197db9a670d1b6ed0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45065 } } peers { permanent_uuid: "8481f3c176784869ba5ae92b1c39d13b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36859 } } peers { permanent_uuid: "d1d6bda086534f6ea55d92824229beb7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 45355 } }
I20260812 00:09:02.395795 8754 raft_consensus.cc:374] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:02.395838 8754 raft_consensus.cc:729] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23be7cad8e1498197db9a670d1b6ed0, State: Initialized, Role: FOLLOWER
I20260812 00:09:02.395967 8754 consensus_queue.cc:260] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23be7cad8e1498197db9a670d1b6ed0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45065 } } peers { permanent_uuid: "8481f3c176784869ba5ae92b1c39d13b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36859 } } peers { permanent_uuid: "d1d6bda086534f6ea55d92824229beb7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 45355 } }
I20260812 00:09:02.396255 8754 ts_tablet_manager.cc:1428] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:09:02.396284 8429 heartbeater.cc:503] Master 127.19.59.126:35457 was elected leader, sending a full tablet report...
I20260812 00:09:02.396835 8755 tablet_bootstrap.cc:492] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b: No bootstrap required, opened a new log
I20260812 00:09:02.396904 8755 ts_tablet_manager.cc:1397] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 00:09:02.397289 8756 raft_consensus.cc:348] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23be7cad8e1498197db9a670d1b6ed0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45065 } } peers { permanent_uuid: "8481f3c176784869ba5ae92b1c39d13b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36859 } } peers { permanent_uuid: "d1d6bda086534f6ea55d92824229beb7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 45355 } }
I20260812 00:09:02.397475 8756 raft_consensus.cc:374] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:02.397524 8756 raft_consensus.cc:729] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d6bda086534f6ea55d92824229beb7, State: Initialized, Role: FOLLOWER
I20260812 00:09:02.397625 8756 consensus_queue.cc:260] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23be7cad8e1498197db9a670d1b6ed0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45065 } } peers { permanent_uuid: "8481f3c176784869ba5ae92b1c39d13b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36859 } } peers { permanent_uuid: "d1d6bda086534f6ea55d92824229beb7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 45355 } }
I20260812 00:09:02.397912 8739 heartbeater.cc:503] Master 127.19.59.126:35457 was elected leader, sending a full tablet report...
I20260812 00:09:02.397909 8756 ts_tablet_manager.cc:1428] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:09:02.398844 8755 raft_consensus.cc:348] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23be7cad8e1498197db9a670d1b6ed0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45065 } } peers { permanent_uuid: "8481f3c176784869ba5ae92b1c39d13b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36859 } } peers { permanent_uuid: "d1d6bda086534f6ea55d92824229beb7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 45355 } }
I20260812 00:09:02.398983 8755 raft_consensus.cc:374] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:02.399029 8755 raft_consensus.cc:729] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8481f3c176784869ba5ae92b1c39d13b, State: Initialized, Role: FOLLOWER
I20260812 00:09:02.399118 8755 consensus_queue.cc:260] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23be7cad8e1498197db9a670d1b6ed0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45065 } } peers { permanent_uuid: "8481f3c176784869ba5ae92b1c39d13b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36859 } } peers { permanent_uuid: "d1d6bda086534f6ea55d92824229beb7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 45355 } }
I20260812 00:09:02.399379 8755 ts_tablet_manager.cc:1428] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:09:02.399422 8585 heartbeater.cc:503] Master 127.19.59.126:35457 was elected leader, sending a full tablet report...
I20260812 00:09:02.418469 8762 raft_consensus.cc:482] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:09:02.418578 8762 raft_consensus.cc:504] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23be7cad8e1498197db9a670d1b6ed0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45065 } } peers { permanent_uuid: "8481f3c176784869ba5ae92b1c39d13b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36859 } } peers { permanent_uuid: "d1d6bda086534f6ea55d92824229beb7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 45355 } }
I20260812 00:09:02.418891 8762 leader_election.cc:288] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d23be7cad8e1498197db9a670d1b6ed0 (127.19.59.65:45065), d1d6bda086534f6ea55d92824229beb7 (127.19.59.67:45355)
I20260812 00:09:02.422252 8751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.419202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:40933 (local address 127.19.59.67:45355)
0812 00:09:02.419247 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:02.419248 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:02.419256 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:09:02.419316 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:02.419316 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:02.419323 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:02.419369 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:02.419510 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.420128 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.421408 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.421918 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.421988 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.421995 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:02.422161 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 00:09:02.422196 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:09:02.422253 8752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.419126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:37065 (local address 127.19.59.65:45065)
0812 00:09:02.419183 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:02.419185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:02.419193 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:09:02.419215 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:02.419216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:02.419226 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:02.419282 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:02.419444 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.420124 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.421408 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.421917 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.421991 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.421997 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:02.422161 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 00:09:02.422197 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:09:02.422294 8587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.419033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:45065 (local address 127.19.59.66:37065)
0812 00:09:02.419087 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:02.419096 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:02.419137 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:02.419295 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:02.419296 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:02.419298 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:02.419375 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.419376 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.420212 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.420213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.421326 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.421329 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.422000 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.422001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.422076 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.422078 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:09:02.422130 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 00:09:02.422188 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":75}
I20260812 00:09:02.422300 8763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.419074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:45355 (local address 127.19.59.66:40933)
0812 00:09:02.419213 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:02.419223 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:02.419268 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:02.419393 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:02.419393 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:02.419395 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:02.419448 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.419449 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.420212 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.420213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.421326 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.421329 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.422006 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.422006 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.422073 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.422077 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:09:02.422130 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 00:09:02.422188 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":43,"thread_start_us":72,"threads_started":1}
I20260812 00:09:02.422591 8377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1444d86c35ec42ee9a529a5b9f27df37" candidate_uuid: "8481f3c176784869ba5ae92b1c39d13b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23be7cad8e1498197db9a670d1b6ed0" is_pre_election: true
I20260812 00:09:02.422653 8682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1444d86c35ec42ee9a529a5b9f27df37" candidate_uuid: "8481f3c176784869ba5ae92b1c39d13b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d6bda086534f6ea55d92824229beb7" is_pre_election: true
I20260812 00:09:02.422700 8377 raft_consensus.cc:2454] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481f3c176784869ba5ae92b1c39d13b in term 0.
I20260812 00:09:02.422780 8682 raft_consensus.cc:2454] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481f3c176784869ba5ae92b1c39d13b in term 0.
I20260812 00:09:02.422995 8453 leader_election.cc:302] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481f3c176784869ba5ae92b1c39d13b, d23be7cad8e1498197db9a670d1b6ed0; no voters:
I20260812 00:09:02.423152 8762 raft_consensus.cc:2781] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:09:02.423210 8762 raft_consensus.cc:482] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:09:02.423226 8762 raft_consensus.cc:3037] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:02.423800 8762 raft_consensus.cc:504] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23be7cad8e1498197db9a670d1b6ed0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45065 } } peers { permanent_uuid: "8481f3c176784869ba5ae92b1c39d13b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36859 } } peers { permanent_uuid: "d1d6bda086534f6ea55d92824229beb7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 45355 } }
I20260812 00:09:02.423938 8762 leader_election.cc:288] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [CANDIDATE]: Term 1 election: Requested vote from peers d23be7cad8e1498197db9a670d1b6ed0 (127.19.59.65:45065), d1d6bda086534f6ea55d92824229beb7 (127.19.59.67:45355)
I20260812 00:09:02.424086 8377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1444d86c35ec42ee9a529a5b9f27df37" candidate_uuid: "8481f3c176784869ba5ae92b1c39d13b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23be7cad8e1498197db9a670d1b6ed0"
I20260812 00:09:02.424109 8682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1444d86c35ec42ee9a529a5b9f27df37" candidate_uuid: "8481f3c176784869ba5ae92b1c39d13b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d6bda086534f6ea55d92824229beb7"
I20260812 00:09:02.424160 8682 raft_consensus.cc:3037] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:02.424157 8377 raft_consensus.cc:3037] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:02.424935 8377 raft_consensus.cc:2454] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481f3c176784869ba5ae92b1c39d13b in term 1.
I20260812 00:09:02.424935 8682 raft_consensus.cc:2454] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481f3c176784869ba5ae92b1c39d13b in term 1.
I20260812 00:09:02.425079 8453 leader_election.cc:302] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 8481f3c176784869ba5ae92b1c39d13b, d1d6bda086534f6ea55d92824229beb7, d23be7cad8e1498197db9a670d1b6ed0; no voters:
I20260812 00:09:02.425168 8762 raft_consensus.cc:2781] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:02.425295 8762 raft_consensus.cc:686] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [term 1 LEADER]: Becoming Leader. State: Replica: 8481f3c176784869ba5ae92b1c39d13b, State: Running, Role: LEADER
I20260812 00:09:02.425406 8762 consensus_queue.cc:237] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23be7cad8e1498197db9a670d1b6ed0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45065 } } peers { permanent_uuid: "8481f3c176784869ba5ae92b1c39d13b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36859 } } peers { permanent_uuid: "d1d6bda086534f6ea55d92824229beb7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 45355 } }
I20260812 00:09:02.426086 8206 catalog_manager.cc:5495] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8481f3c176784869ba5ae92b1c39d13b (127.19.59.66). New cstate: current_term: 1 leader_uuid: "8481f3c176784869ba5ae92b1c39d13b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23be7cad8e1498197db9a670d1b6ed0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481f3c176784869ba5ae92b1c39d13b" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1d6bda086534f6ea55d92824229beb7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 45355 } health_report { overall_health: UNKNOWN } } }
I20260812 00:09:02.434044 8753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.431783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50290 (local address 127.19.59.66:36859)
0812 00:09:02.431823 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:02.431825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:02.431834 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:09:02.431884 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:02.431885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:02.431901 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:02.431960 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:09:02.432065 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.432497 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.433227 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.433436 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.433505 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.433660 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:09:02.433744 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:09:02.433859 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:02.433930 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:09:02.433941 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:09:02.435284 8682 raft_consensus.cc:1261] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7 [term 1 FOLLOWER]: Refusing update from remote peer 8481f3c176784869ba5ae92b1c39d13b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:09:02.435284 8377 raft_consensus.cc:1261] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0 [term 1 FOLLOWER]: Refusing update from remote peer 8481f3c176784869ba5ae92b1c39d13b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:09:02.435587 8764 consensus_queue.cc:1035] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1d6bda086534f6ea55d92824229beb7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:09:02.435705 8762 consensus_queue.cc:1035] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23be7cad8e1498197db9a670d1b6ed0" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 45065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:09:02.437990 8767 mvcc.cc:205] Tried to move back new op lower bound from 7317476730613002240 to 7317476730575196160. Current Snapshot: MvccSnapshot[applied={T|T < 7317476730613002240}]
I20260812 00:09:02.438468 8770 mvcc.cc:205] Tried to move back new op lower bound from 7317476730613002240 to 7317476730575196160. Current Snapshot: MvccSnapshot[applied={T|T < 7317476730613002240}]
I20260812 00:09:02.438984 8768 mvcc.cc:205] Tried to move back new op lower bound from 7317476730613002240 to 7317476730575196160. Current Snapshot: MvccSnapshot[applied={T|T < 7317476730613002240}]
I20260812 00:09:02.439909 8206 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:09:02.439985 8206 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:09:02.440580 8206 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 22e08a8680c04c9abe4595e7865a07d4: Sending DeleteTablet for 3 replicas of tablet 1444d86c35ec42ee9a529a5b9f27df37
I20260812 00:09:02.440871 8662 tablet_service.cc:1514] Processing DeleteTablet for tablet 1444d86c35ec42ee9a529a5b9f27df37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:02 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:32904
I20260812 00:09:02.440874 8353 tablet_service.cc:1514] Processing DeleteTablet for tablet 1444d86c35ec42ee9a529a5b9f27df37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:02 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:36002
I20260812 00:09:02.441087 8778 tablet_replica.cc:330] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7: stopping tablet replica
I20260812 00:09:02.441073 8505 tablet_service.cc:1514] Processing DeleteTablet for tablet 1444d86c35ec42ee9a529a5b9f27df37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:02 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:50282
I20260812 00:09:02.441167 8778 raft_consensus.cc:2229] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:09:02.441250 8778 raft_consensus.cc:2258] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:09:02.441330 8779 tablet_replica.cc:330] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0: stopping tablet replica
I20260812 00:09:02.441414 8779 raft_consensus.cc:2229] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:09:02.441519 8779 raft_consensus.cc:2258] T 1444d86c35ec42ee9a529a5b9f27df37 P d23be7cad8e1498197db9a670d1b6ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:09:02.441606 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 8282
I20260812 00:09:02.444682 8778 ts_tablet_manager.cc:1905] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:09:02.446115 8778 ts_tablet_manager.cc:1918] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:09:02.446177 8778 log.cc:1196] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/1444d86c35ec42ee9a529a5b9f27df37
I20260812 00:09:02.446422 8778 ts_tablet_manager.cc:1939] T 1444d86c35ec42ee9a529a5b9f27df37 P d1d6bda086534f6ea55d92824229beb7: Deleting consensus metadata
I20260812 00:09:02.446808 8192 catalog_manager.cc:4841] TS d1d6bda086534f6ea55d92824229beb7 (127.19.59.67:45355): tablet 1444d86c35ec42ee9a529a5b9f27df37 (table test-table [id=2f040223429e48d1a3a3df45252f4c07]) successfully deleted
I20260812 00:09:02.451602 8780 tablet_replica.cc:330] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b: stopping tablet replica
I20260812 00:09:02.451725 8780 raft_consensus.cc:2229] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:09:02.451809 8780 raft_consensus.cc:2258] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:09:02.454135 8780 ts_tablet_manager.cc:1905] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:09:02.455286 8780 ts_tablet_manager.cc:1918] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:09:02.455375 8780 log.cc:1196] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/1444d86c35ec42ee9a529a5b9f27df37
I20260812 00:09:02.455646 8780 ts_tablet_manager.cc:1939] T 1444d86c35ec42ee9a529a5b9f27df37 P 8481f3c176784869ba5ae92b1c39d13b: Deleting consensus metadata
I20260812 00:09:02.456000 8193 catalog_manager.cc:4841] TS 8481f3c176784869ba5ae92b1c39d13b (127.19.59.66:36859): tablet 1444d86c35ec42ee9a529a5b9f27df37 (table test-table [id=2f040223429e48d1a3a3df45252f4c07]) successfully deleted
W20260812 00:09:02.456398 8190 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:45065 (error 108)
I20260812 00:09:02.456583 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 8435
I20260812 00:09:02.456816 8748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.456713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:45065 (local address 127.0.0.1:36004)
0812 00:09:02.456753 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:02.456782 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:45065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 00:09:02.457461 8190 catalog_manager.cc:4584] TS d23be7cad8e1498197db9a670d1b6ed0 (127.19.59.65:45065): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1444d86c35ec42ee9a529a5b9f27df37: Network error: Client connection negotiation failed: client connection to 127.19.59.65:45065: connect: Connection refused (error 111)
I20260812 00:09:02.463075 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 8591
I20260812 00:09:02.473338 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 8173
2026-08-12T00:09:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (1865 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T00:09:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:02Z Disabled control of system clock
I20260812 00:09:02.502354 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:38899
--webserver_interface=127.19.59.126
--webserver_port=0
--builtin_ntp_servers=127.19.59.84:40639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:38899
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:09:02.577586 8787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:02.577757 8787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:02.577775 8787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:02.578749 8787 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:02.578786 8787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:02.578797 8787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:02.578809 8787 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:02.578819 8787 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:02.579917 8787 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:40639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:38899
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:38899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:02.580090 8787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:02.580283 8787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:02.584719 8792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:02.584758 8793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:02.584749 8787 server_base.cc:1034] running on GCE node
W20260812 00:09:02.584719 8795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:02.585131 8787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:02.585408 8787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:02.586580 8787 hybrid_clock.cc:648] HybridClock initialized: now 1786493342586572 us; error 35 us; skew 500 ppm
I20260812 00:09:02.587690 8787 webserver.cc:460] Webserver started at http://127.19.59.126:45079/ using document root <none> and password file <none>
I20260812 00:09:02.587929 8787 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:02.588003 8787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:02.588147 8787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:02.589066 8787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "d73b36179c8f4313a277eef5425f39e3"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "bf90c4150a087c333f38487964cc677e"
server_key_iv: "a2ecab1410ae05605c189f53028bb0c5"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.589380 8787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "d73b36179c8f4313a277eef5425f39e3"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "bf90c4150a087c333f38487964cc677e"
server_key_iv: "a2ecab1410ae05605c189f53028bb0c5"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.590634 8787 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:09:02.591325 8801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.591480 8787 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:09:02.591571 8787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "d73b36179c8f4313a277eef5425f39e3"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "bf90c4150a087c333f38487964cc677e"
server_key_iv: "a2ecab1410ae05605c189f53028bb0c5"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.591673 8787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:02.605366 8787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:02.605657 8787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:02.605779 8787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:02.610224 8787 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:38899
I20260812 00:09:02.610242 8860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:38899 every 8 connection(s)
I20260812 00:09:02.610625 8787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:02.611532 8863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:02.613528 8863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3: Bootstrap starting.
I20260812 00:09:02.614154 8863 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:02.614445 8863 log.cc:824] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:02.615068 8863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3: No bootstrap required, opened a new log
I20260812 00:09:02.616178 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 8787
I20260812 00:09:02.616253 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:02.616441 19693 external_mini_cluster.cc:1428] Setting key 95baee3f20225619151262534ee64d54
I20260812 00:09:02.616566 8863 raft_consensus.cc:348] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d73b36179c8f4313a277eef5425f39e3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 38899 } }
I20260812 00:09:02.616734 8863 raft_consensus.cc:374] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:02.616776 8863 raft_consensus.cc:729] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73b36179c8f4313a277eef5425f39e3, State: Initialized, Role: FOLLOWER
I20260812 00:09:02.616909 8863 consensus_queue.cc:260] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d73b36179c8f4313a277eef5425f39e3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 38899 } }
I20260812 00:09:02.616993 8863 raft_consensus.cc:388] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:02.617038 8863 raft_consensus.cc:482] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:02.617084 8863 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:02.617792 8863 raft_consensus.cc:504] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d73b36179c8f4313a277eef5425f39e3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 38899 } }
I20260812 00:09:02.617935 8863 leader_election.cc:302] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d73b36179c8f4313a277eef5425f39e3; no voters:
I20260812 00:09:02.618112 8863 leader_election.cc:288] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:02.618177 8870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:02.618314 8870 raft_consensus.cc:686] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [term 1 LEADER]: Becoming Leader. State: Replica: d73b36179c8f4313a277eef5425f39e3, State: Running, Role: LEADER
I20260812 00:09:02.618364 8863 sys_catalog.cc:564] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:02.618400 8870 consensus_queue.cc:237] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d73b36179c8f4313a277eef5425f39e3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 38899 } }
I20260812 00:09:02.618733 8870 sys_catalog.cc:455] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d73b36179c8f4313a277eef5425f39e3. Latest consensus state: current_term: 1 leader_uuid: "d73b36179c8f4313a277eef5425f39e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d73b36179c8f4313a277eef5425f39e3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 38899 } } }
I20260812 00:09:02.618818 8870 sys_catalog.cc:458] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:02.618746 8872 sys_catalog.cc:455] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d73b36179c8f4313a277eef5425f39e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d73b36179c8f4313a277eef5425f39e3" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 38899 } } }
I20260812 00:09:02.619006 8878 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:02.619040 8872 sys_catalog.cc:458] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:02.619470 8878 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:02.621498 8890 mvcc.cc:205] Tried to move back new op lower bound from 7317476731372724224 to 7317476731365502976. Current Snapshot: MvccSnapshot[applied={T|T < 7317476731372724224}]
I20260812 00:09:02.622210 8869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.616901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41088 (local address 127.19.59.126:38899)
0812 00:09:02.617177 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:02.617185 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:02.617213 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:09:02.617318 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:02.617342 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:02.617419 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:02.617573 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:02.617828 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.619519 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.620365 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.620688 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.620757 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.621478 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:02.621481 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:02.621481 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:02.621629 (+ 148us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:02.621658 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:02.621667 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:02.621715 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:02.621878 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 00:09:02.621969 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":105,"threads_started":1}
I20260812 00:09:02.622548 8878 catalog_manager.cc:1347] Generated new cluster ID: e6a3e61596154dfda6545a4686aff3db
I20260812 00:09:02.622596 8878 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:02.635774 8878 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:02.636206 8878 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:02.639140 8878 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3: Generated new TSK 0
I20260812 00:09:02.639307 8878 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:02.642611 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:38899
--builtin_ntp_servers=127.19.59.84:40639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:09:02.720005 8893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:02.720191 8893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:02.720211 8893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:02.721213 8893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:02.721248 8893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:02.721269 8893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:09:02.722622 8893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:40639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:38899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:02.722841 8893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:02.723184 8893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:02.727993 8899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:02.727998 8900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:02.728030 8902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:02.728284 8893 server_base.cc:1034] running on GCE node
I20260812 00:09:02.728471 8893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:02.728721 8893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:02.729871 8893 hybrid_clock.cc:648] HybridClock initialized: now 1786493342729838 us; error 49 us; skew 500 ppm
I20260812 00:09:02.731089 8893 webserver.cc:460] Webserver started at http://127.19.59.65:41811/ using document root <none> and password file <none>
I20260812 00:09:02.731312 8893 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:02.731375 8893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:02.731503 8893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:02.732510 8893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "09cea41af7034e669c6567b3bed93e33"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "3a34f79e31baf1531a482148ac8615e3"
server_key_iv: "a3b34e94c39bf1519b7b36efbbbb8d86"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.732883 8893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "09cea41af7034e669c6567b3bed93e33"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "3a34f79e31baf1531a482148ac8615e3"
server_key_iv: "a3b34e94c39bf1519b7b36efbbbb8d86"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.734279 8893 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:09:02.735046 8908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.735219 8893 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:09:02.735316 8893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "09cea41af7034e669c6567b3bed93e33"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "3a34f79e31baf1531a482148ac8615e3"
server_key_iv: "a3b34e94c39bf1519b7b36efbbbb8d86"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.735380 8893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:02.741406 8893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:02.741659 8893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:02.741792 8893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:02.742022 8893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:09:02.742311 8893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:09:02.742362 8893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.742398 8893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:09:02.742421 8893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.748210 8893 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:41007
I20260812 00:09:02.748279 9040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:41007 every 8 connection(s)
I20260812 00:09:02.748546 8893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:09:02.753414 8869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.749204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:40121 (local address 127.19.59.126:38899)
0812 00:09:02.749245 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:02.749247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:02.749418 (+ 171us) server_negotiation.cc:407] Connection header received
0812 00:09:02.749956 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:02.749957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:02.749971 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:02.750028 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:02.750673 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.751133 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.752075 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.752285 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.752371 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.753106 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:02.753107 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:02.753107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:02.753115 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:02.753129 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:02.753134 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:02.753205 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:02.753298 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 00:09:02.753329 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:09:02.753615 9044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.749159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:38899 (local address 127.19.59.65:40121)
0812 00:09:02.749303 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:02.749340 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:02.749806 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:02.750090 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:02.750093 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:02.750102 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:02.750564 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.750568 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.751227 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.751228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.751980 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.751982 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.752381 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.752382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.752521 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.752969 (+ 448us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:09:02.752970 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:02.752995 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:09:02.753015 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:02.753203 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:02.753210 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:02.753212 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:09:02.753300 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 00:09:02.753394 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":56,"threads_started":1}
I20260812 00:09:02.754164 9041 heartbeater.cc:347] Connected to a master server at 127.19.59.126:38899
I20260812 00:09:02.754256 9041 heartbeater.cc:464] Registering TS with master...
I20260812 00:09:02.754384 9041 heartbeater.cc:511] Master 127.19.59.126:38899 requested a full tablet report, sending...
I20260812 00:09:02.754871 8820 ts_manager.cc:194] Registered new tserver with Master: 09cea41af7034e669c6567b3bed93e33 (127.19.59.65:41007)
I20260812 00:09:02.755415 8820 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.59.65:40121
I20260812 00:09:02.757524 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 8893
I20260812 00:09:02.757647 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:09:02.757860 19693 external_mini_cluster.cc:1428] Setting key 101eddb41b90db7930620b6286ac3fc9
I20260812 00:09:02.758596 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:38899
--builtin_ntp_servers=127.19.59.84:40639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:09:02.834363 9045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:02.834518 9045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:02.834537 9045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:02.835479 9045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:02.835507 9045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:02.835528 9045 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:09:02.836596 9045 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:40639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:38899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:02.836752 9045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:02.836948 9045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:02.841329 9052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:02.841306 9051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:02.841374 9045 server_base.cc:1034] running on GCE node
W20260812 00:09:02.841318 9054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:02.841706 9045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:02.842005 9045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:02.843137 9045 hybrid_clock.cc:648] HybridClock initialized: now 1786493342843132 us; error 32 us; skew 500 ppm
I20260812 00:09:02.844331 9045 webserver.cc:460] Webserver started at http://127.19.59.66:34863/ using document root <none> and password file <none>
I20260812 00:09:02.844583 9045 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:02.844626 9045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:02.844772 9045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:02.845697 9045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "ddace4aa7f1e4869abdb94f2730e827f"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "48018405cb357e98f90f3b5a18b3acce"
server_key_iv: "871ebe4802e29bea18bcfdb4e2e58b71"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.846035 9045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "ddace4aa7f1e4869abdb94f2730e827f"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "48018405cb357e98f90f3b5a18b3acce"
server_key_iv: "871ebe4802e29bea18bcfdb4e2e58b71"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.847102 9045 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:09:02.847714 9062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.847914 9045 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.847993 9045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "ddace4aa7f1e4869abdb94f2730e827f"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "48018405cb357e98f90f3b5a18b3acce"
server_key_iv: "871ebe4802e29bea18bcfdb4e2e58b71"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.848054 9045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:02.872139 9045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:02.872437 9045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:02.872586 9045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:02.872825 9045 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:09:02.873242 9045 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:09:02.873296 9045 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.873335 9045 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:09:02.873363 9045 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.878858 9045 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:41317
I20260812 00:09:02.878901 9192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:41317 every 8 connection(s)
I20260812 00:09:02.879256 9045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:09:02.883436 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 9045
I20260812 00:09:02.883558 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:09:02.883750 19693 external_mini_cluster.cc:1428] Setting key 622bae2fe11f54b2d3251170329986e4
I20260812 00:09:02.884209 8869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.879992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:47415 (local address 127.19.59.126:38899)
0812 00:09:02.880064 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:02.880065 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:02.880244 (+ 179us) server_negotiation.cc:407] Connection header received
0812 00:09:02.880674 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:02.880675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:02.880685 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:02.880742 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:02.881348 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.881789 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.882691 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.882889 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.882958 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.883833 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:02.883835 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:02.883835 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:02.883840 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:02.883858 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:02.883863 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:02.883949 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:02.884089 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 00:09:02.884119 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 00:09:02.884398 9195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:02.879916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:38899 (local address 127.19.59.66:47415)
0812 00:09:02.880118 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:02.880156 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:02.880593 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:02.880804 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:02.880807 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:02.880815 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:02.881276 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.881280 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.881901 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.881902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.882617 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:02.882618 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:02.882998 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:02.882998 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:02.883108 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:02.883685 (+ 577us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:09:02.883685 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:02.883713 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:09:02.883735 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:02.883967 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:02.883974 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:02.883977 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:09:02.884058 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 00:09:02.884191 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":82,"threads_started":1}
I20260812 00:09:02.884912 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:38899
--builtin_ntp_servers=127.19.59.84:40639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:09:02.884951 9193 heartbeater.cc:347] Connected to a master server at 127.19.59.126:38899
I20260812 00:09:02.885042 9193 heartbeater.cc:464] Registering TS with master...
I20260812 00:09:02.885218 9193 heartbeater.cc:511] Master 127.19.59.126:38899 requested a full tablet report, sending...
I20260812 00:09:02.885632 8820 ts_manager.cc:194] Registered new tserver with Master: ddace4aa7f1e4869abdb94f2730e827f (127.19.59.66:41317)
I20260812 00:09:02.886163 8820 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.59.66:47415
W20260812 00:09:02.964892 9196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:02.965147 9196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:02.965181 9196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:02.966269 9196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:02.966333 9196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:02.966374 9196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:09:02.967700 9196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:40639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:38899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:02.967947 9196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:02.968227 9196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:02.973124 9205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:02.973112 9202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:02.973124 9203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:02.973160 9196 server_base.cc:1034] running on GCE node
I20260812 00:09:02.973563 9196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:02.973747 9196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:02.974884 9196 hybrid_clock.cc:648] HybridClock initialized: now 1786493342974865 us; error 35 us; skew 500 ppm
I20260812 00:09:02.976132 9196 webserver.cc:460] Webserver started at http://127.19.59.67:32925/ using document root <none> and password file <none>
I20260812 00:09:02.976375 9196 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:02.976423 9196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:02.976581 9196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:02.977530 9196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "cd4cdb506c334663bc08f8cabce57aa7"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "b70ffa4bc0764a870b2a185312f12d75"
server_key_iv: "80bbd1a7b6d4d4a0141525f8689317c8"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.977927 9196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "cd4cdb506c334663bc08f8cabce57aa7"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "b70ffa4bc0764a870b2a185312f12d75"
server_key_iv: "80bbd1a7b6d4d4a0141525f8689317c8"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.979146 9196 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:09:02.979822 9215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:02.980013 9196 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:02.980103 9196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "cd4cdb506c334663bc08f8cabce57aa7"
format_stamp: "Formatted at 2026-08-12 00:09:02 on dist-test-slave-6nmv"
server_key: "b70ffa4bc0764a870b2a185312f12d75"
server_key_iv: "80bbd1a7b6d4d4a0141525f8689317c8"
server_key_version: "encryptionkey@0"
I20260812 00:09:02.980171 9196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:02.999061 9196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:02.999341 9196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:02.999478 9196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:02.999688 9196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:09:03.000007 9196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:09:03.000058 9196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:03.000090 9196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:09:03.000114 9196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:03.005690 9196 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:33337
I20260812 00:09:03.005803 9344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:33337 every 8 connection(s)
I20260812 00:09:03.006158 9196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:09:03.010600 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 9196
I20260812 00:09:03.010710 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:09:03.010895 19693 external_mini_cluster.cc:1428] Setting key 9d25d061ea5c60ad2100327938db075f
I20260812 00:09:03.011449 8869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:03.006909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:35757 (local address 127.19.59.126:38899)
0812 00:09:03.006957 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:03.006959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:03.007160 (+ 201us) server_negotiation.cc:407] Connection header received
0812 00:09:03.007695 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:03.007697 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:03.007711 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:03.007767 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:03.008451 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.008933 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.009973 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.010191 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.010298 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:03.011193 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:03.011195 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:03.011195 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:03.011200 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:03.011215 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:03.011219 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:03.011267 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:03.011339 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 00:09:03.011369 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:09:03.011667 9347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:03.006864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:38899 (local address 127.19.59.67:35757)
0812 00:09:03.007038 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:03.007072 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:03.007581 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:03.007836 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:03.007840 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:03.007850 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:03.008336 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:03.008340 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.009064 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.009070 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:03.009873 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:03.009875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.010309 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.010310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:03.010442 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:03.011044 (+ 602us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:09:03.011045 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:03.011082 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:09:03.011104 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:03.011266 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:03.011271 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:03.011274 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:09:03.011340 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 00:09:03.011433 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":67,"threads_started":1}
I20260812 00:09:03.012167 9345 heartbeater.cc:347] Connected to a master server at 127.19.59.126:38899
I20260812 00:09:03.012259 9345 heartbeater.cc:464] Registering TS with master...
I20260812 00:09:03.012392 9345 heartbeater.cc:511] Master 127.19.59.126:38899 requested a full tablet report, sending...
I20260812 00:09:03.012724 8820 ts_manager.cc:194] Registered new tserver with Master: cd4cdb506c334663bc08f8cabce57aa7 (127.19.59.67:33337)
I20260812 00:09:03.013043 8820 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.59.67:35757
I20260812 00:09:03.022660 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:09:03.026638 8869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:03.024046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41096 (local address 127.19.59.126:38899)
0812 00:09:03.024150 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:03.024152 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:03.024190 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:09:03.024246 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:03.024247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:03.024255 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:03.024298 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:03.024427 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.024832 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.025480 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.025639 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.025684 (+ 45us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:03.026320 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:03.026321 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:03.026322 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:03.026325 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:03.026338 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:03.026342 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:03.026416 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:03.026493 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 00:09:03.026522 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 00:09:03.028041 8820 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41096:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:09:03.029464 8820 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:09:03.035362 9356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:03.031507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:33337 (local address 127.0.0.1:44908)
0812 00:09:03.031864 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:03.031876 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:03.031931 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:03.032143 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:03.032144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:03.032146 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:03.032183 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:03.032185 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.033066 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.033067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:03.034372 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:03.034375 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.035081 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.035082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:03.035160 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:03.035173 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 00:09:03.035243 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 00:09:03.035291 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":23,"thread_start_us":67,"threads_started":1}
I20260812 00:09:03.035369 9359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:03.031699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44908 (local address 127.19.59.67:33337)
0812 00:09:03.031858 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:03.031862 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:03.031923 (+ 61us) server_negotiation.cc:407] Connection header received
0812 00:09:03.031998 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:03.032001 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:03.032015 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:03.032088 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:03.032257 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.032967 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.034457 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.034981 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.035078 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:03.035164 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:03.035256 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 00:09:03.035291 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":88,"threads_started":1}
I20260812 00:09:03.035534 9355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:03.031331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:41317 (local address 127.0.0.1:44778)
0812 00:09:03.031533 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:03.031570 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:03.031647 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:03.031934 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:03.031937 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:03.031939 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:03.032002 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:03.032004 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.033359 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.033360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:03.034457 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:03.034459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.035300 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.035301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:03.035365 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:03.035369 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:09:03.035399 (+ 30us) client_negotiation.cc:240] Negotiation successful
0812 00:09:03.035438 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":56,"threads_started":1}
I20260812 00:09:03.035691 9354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:03.031380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:41007 (local address 127.0.0.1:40566)
0812 00:09:03.031780 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:03.031790 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:03.031838 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:03.032265 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:03.032266 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:03.032268 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:03.032316 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:03.032318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.033532 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.033534 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:03.034536 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:03.034539 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.035460 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.035461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:03.035526 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:03.035529 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:09:03.035575 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 00:09:03.035611 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":94,"threads_started":1}
I20260812 00:09:03.035923 9358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:03.031551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44778 (local address 127.19.59.66:41317)
0812 00:09:03.031766 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:03.031770 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:03.031781 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:09:03.031823 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:03.031825 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:03.031841 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:03.031931 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:03.032127 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.033272 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.034517 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.035195 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.035690 (+ 495us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:03.035788 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:03.035812 (+ 24us) server_negotiation.cc:299] Negotiation successful
0812 00:09:03.035847 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":124,"threads_started":1}
I20260812 00:09:03.035930 9357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:03.031477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40566 (local address 127.19.59.65:41007)
0812 00:09:03.032061 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:03.032064 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:03.032074 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:09:03.032113 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:03.032114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:03.032129 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:03.032202 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:03.032392 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.033449 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.034621 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.035287 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.035346 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:03.035429 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:03.035821 (+ 392us) server_negotiation.cc:299] Negotiation successful
0812 00:09:03.035860 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":98,"threads_started":1}
I20260812 00:09:03.036312 9268 tablet_service.cc:1467] Processing CreateTablet for tablet caafb11bc7cf43829238d43d4596a10e (DEFAULT_TABLE table=test-table [id=bbcd15f774c04e1b9c6701d08dae9102]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:09:03.036509 9118 tablet_service.cc:1467] Processing CreateTablet for tablet caafb11bc7cf43829238d43d4596a10e (DEFAULT_TABLE table=test-table [id=bbcd15f774c04e1b9c6701d08dae9102]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:09:03.036653 9268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caafb11bc7cf43829238d43d4596a10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:03.036738 9118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caafb11bc7cf43829238d43d4596a10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:03.036669 8967 tablet_service.cc:1467] Processing CreateTablet for tablet caafb11bc7cf43829238d43d4596a10e (DEFAULT_TABLE table=test-table [id=bbcd15f774c04e1b9c6701d08dae9102]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:09:03.036955 8967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caafb11bc7cf43829238d43d4596a10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:03.039479 9360 tablet_bootstrap.cc:492] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f: Bootstrap starting.
I20260812 00:09:03.039886 9362 tablet_bootstrap.cc:492] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7: Bootstrap starting.
I20260812 00:09:03.040307 9363 tablet_bootstrap.cc:492] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33: Bootstrap starting.
I20260812 00:09:03.040395 9360 tablet_bootstrap.cc:654] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:03.040527 9362 tablet_bootstrap.cc:654] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:03.040741 9360 log.cc:824] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:03.040848 9362 log.cc:824] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:03.040961 9363 tablet_bootstrap.cc:654] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:03.041253 9363 log.cc:824] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:03.041616 9362 tablet_bootstrap.cc:492] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7: No bootstrap required, opened a new log
I20260812 00:09:03.041700 9362 ts_tablet_manager.cc:1397] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:09:03.042047 9363 tablet_bootstrap.cc:492] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33: No bootstrap required, opened a new log
I20260812 00:09:03.042117 9363 ts_tablet_manager.cc:1397] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:09:03.042236 9360 tablet_bootstrap.cc:492] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f: No bootstrap required, opened a new log
I20260812 00:09:03.042326 9360 ts_tablet_manager.cc:1397] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 00:09:03.044189 9360 raft_consensus.cc:348] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddace4aa7f1e4869abdb94f2730e827f" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 41317 } } peers { permanent_uuid: "cd4cdb506c334663bc08f8cabce57aa7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33337 } } peers { permanent_uuid: "09cea41af7034e669c6567b3bed93e33" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 41007 } }
I20260812 00:09:03.044341 9360 raft_consensus.cc:374] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:03.044384 9360 raft_consensus.cc:729] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddace4aa7f1e4869abdb94f2730e827f, State: Initialized, Role: FOLLOWER
I20260812 00:09:03.044523 9360 consensus_queue.cc:260] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddace4aa7f1e4869abdb94f2730e827f" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 41317 } } peers { permanent_uuid: "cd4cdb506c334663bc08f8cabce57aa7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33337 } } peers { permanent_uuid: "09cea41af7034e669c6567b3bed93e33" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 41007 } }
I20260812 00:09:03.044442 9362 raft_consensus.cc:348] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddace4aa7f1e4869abdb94f2730e827f" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 41317 } } peers { permanent_uuid: "cd4cdb506c334663bc08f8cabce57aa7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33337 } } peers { permanent_uuid: "09cea41af7034e669c6567b3bed93e33" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 41007 } }
I20260812 00:09:03.044607 9362 raft_consensus.cc:374] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:03.044654 9362 raft_consensus.cc:729] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd4cdb506c334663bc08f8cabce57aa7, State: Initialized, Role: FOLLOWER
I20260812 00:09:03.044780 9360 ts_tablet_manager.cc:1428] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:09:03.044780 9362 consensus_queue.cc:260] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddace4aa7f1e4869abdb94f2730e827f" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 41317 } } peers { permanent_uuid: "cd4cdb506c334663bc08f8cabce57aa7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33337 } } peers { permanent_uuid: "09cea41af7034e669c6567b3bed93e33" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 41007 } }
I20260812 00:09:03.044778 9363 raft_consensus.cc:348] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddace4aa7f1e4869abdb94f2730e827f" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 41317 } } peers { permanent_uuid: "cd4cdb506c334663bc08f8cabce57aa7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33337 } } peers { permanent_uuid: "09cea41af7034e669c6567b3bed93e33" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 41007 } }
I20260812 00:09:03.044924 9363 raft_consensus.cc:374] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:03.044936 9193 heartbeater.cc:503] Master 127.19.59.126:38899 was elected leader, sending a full tablet report...
I20260812 00:09:03.044961 9363 raft_consensus.cc:729] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09cea41af7034e669c6567b3bed93e33, State: Initialized, Role: FOLLOWER
I20260812 00:09:03.045013 9362 ts_tablet_manager.cc:1428] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260812 00:09:03.045111 9345 heartbeater.cc:503] Master 127.19.59.126:38899 was elected leader, sending a full tablet report...
I20260812 00:09:03.045076 9363 consensus_queue.cc:260] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddace4aa7f1e4869abdb94f2730e827f" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 41317 } } peers { permanent_uuid: "cd4cdb506c334663bc08f8cabce57aa7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33337 } } peers { permanent_uuid: "09cea41af7034e669c6567b3bed93e33" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 41007 } }
I20260812 00:09:03.045310 9363 ts_tablet_manager.cc:1428] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:09:03.045423 9041 heartbeater.cc:503] Master 127.19.59.126:38899 was elected leader, sending a full tablet report...
W20260812 00:09:03.129850 9194 tablet.cc:2369] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:09:03.249396 9043 tablet.cc:2369] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:09:03.256681 9346 tablet.cc:2369] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:09:03.365774 9367 raft_consensus.cc:482] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:09:03.365947 9367 raft_consensus.cc:504] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddace4aa7f1e4869abdb94f2730e827f" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 41317 } } peers { permanent_uuid: "cd4cdb506c334663bc08f8cabce57aa7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33337 } } peers { permanent_uuid: "09cea41af7034e669c6567b3bed93e33" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 41007 } }
I20260812 00:09:03.366380 9367 leader_election.cc:288] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd4cdb506c334663bc08f8cabce57aa7 (127.19.59.67:33337), 09cea41af7034e669c6567b3bed93e33 (127.19.59.65:41007)
I20260812 00:09:03.369060 9195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:03.366554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:33337 (local address 127.19.59.66:54015)
0812 00:09:03.366611 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:03.366624 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:03.366672 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:03.366837 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:03.366839 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:03.366842 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:03.366931 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:03.366933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.367686 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.367687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:03.368329 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:03.368331 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.368847 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.368848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:03.368915 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:03.368918 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:09:03.368955 (+ 37us) client_negotiation.cc:240] Negotiation successful
0812 00:09:03.368983 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 00:09:03.369092 9359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:03.366621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:54015 (local address 127.19.59.67:33337)
0812 00:09:03.366679 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:03.366681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:03.366693 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:09:03.366734 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:03.366735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:03.366747 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:03.366825 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:03.367104 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.367606 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.368425 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.368773 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.368830 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:03.368857 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:03.368979 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 00:09:03.369023 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:09:03.369169 9371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:03.366604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:41007 (local address 127.19.59.66:57567)
0812 00:09:03.366727 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:03.366737 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:03.366803 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:03.367093 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:03.367094 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:03.367096 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:03.367169 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:03.367170 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.367749 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.367750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:03.368403 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:03.368405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.368892 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.368893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:03.368983 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:03.368987 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:09:03.369042 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 00:09:03.369075 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
I20260812 00:09:03.369172 9357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:03.366681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:57567 (local address 127.19.59.65:41007)
0812 00:09:03.366724 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:03.366726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:03.366841 (+ 115us) server_negotiation.cc:407] Connection header received
0812 00:09:03.366870 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:03.366871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:03.366895 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:03.366946 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:03.367258 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.367666 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.368489 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.368787 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.368866 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:03.368873 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:03.369063 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 00:09:03.369104 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:09:03.369426 8988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caafb11bc7cf43829238d43d4596a10e" candidate_uuid: "ddace4aa7f1e4869abdb94f2730e827f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09cea41af7034e669c6567b3bed93e33" is_pre_election: true
I20260812 00:09:03.369431 9289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caafb11bc7cf43829238d43d4596a10e" candidate_uuid: "ddace4aa7f1e4869abdb94f2730e827f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd4cdb506c334663bc08f8cabce57aa7" is_pre_election: true
I20260812 00:09:03.369558 8988 raft_consensus.cc:2454] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddace4aa7f1e4869abdb94f2730e827f in term 0.
I20260812 00:09:03.369557 9289 raft_consensus.cc:2454] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddace4aa7f1e4869abdb94f2730e827f in term 0.
I20260812 00:09:03.369803 9067 leader_election.cc:302] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09cea41af7034e669c6567b3bed93e33, ddace4aa7f1e4869abdb94f2730e827f; no voters:
I20260812 00:09:03.369939 9367 raft_consensus.cc:2781] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:09:03.369988 9367 raft_consensus.cc:482] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:09:03.370009 9367 raft_consensus.cc:3037] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:03.370638 9367 raft_consensus.cc:504] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddace4aa7f1e4869abdb94f2730e827f" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 41317 } } peers { permanent_uuid: "cd4cdb506c334663bc08f8cabce57aa7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33337 } } peers { permanent_uuid: "09cea41af7034e669c6567b3bed93e33" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 41007 } }
I20260812 00:09:03.370757 9367 leader_election.cc:288] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [CANDIDATE]: Term 1 election: Requested vote from peers cd4cdb506c334663bc08f8cabce57aa7 (127.19.59.67:33337), 09cea41af7034e669c6567b3bed93e33 (127.19.59.65:41007)
I20260812 00:09:03.370934 8988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caafb11bc7cf43829238d43d4596a10e" candidate_uuid: "ddace4aa7f1e4869abdb94f2730e827f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09cea41af7034e669c6567b3bed93e33"
I20260812 00:09:03.370939 9289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caafb11bc7cf43829238d43d4596a10e" candidate_uuid: "ddace4aa7f1e4869abdb94f2730e827f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd4cdb506c334663bc08f8cabce57aa7"
I20260812 00:09:03.371018 8988 raft_consensus.cc:3037] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:03.371040 9289 raft_consensus.cc:3037] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:03.371762 8988 raft_consensus.cc:2454] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddace4aa7f1e4869abdb94f2730e827f in term 1.
I20260812 00:09:03.371927 9067 leader_election.cc:302] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09cea41af7034e669c6567b3bed93e33, ddace4aa7f1e4869abdb94f2730e827f; no voters:
I20260812 00:09:03.371950 9289 raft_consensus.cc:2454] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddace4aa7f1e4869abdb94f2730e827f in term 1.
I20260812 00:09:03.372041 9367 raft_consensus.cc:2781] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:03.372224 9367 raft_consensus.cc:686] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [term 1 LEADER]: Becoming Leader. State: Replica: ddace4aa7f1e4869abdb94f2730e827f, State: Running, Role: LEADER
I20260812 00:09:03.372319 9367 consensus_queue.cc:237] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddace4aa7f1e4869abdb94f2730e827f" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 41317 } } peers { permanent_uuid: "cd4cdb506c334663bc08f8cabce57aa7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33337 } } peers { permanent_uuid: "09cea41af7034e669c6567b3bed93e33" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 41007 } }
I20260812 00:09:03.373139 8820 catalog_manager.cc:5495] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f reported cstate change: term changed from 0 to 1, leader changed from <none> to ddace4aa7f1e4869abdb94f2730e827f (127.19.59.66). New cstate: current_term: 1 leader_uuid: "ddace4aa7f1e4869abdb94f2730e827f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddace4aa7f1e4869abdb94f2730e827f" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 41317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd4cdb506c334663bc08f8cabce57aa7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09cea41af7034e669c6567b3bed93e33" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 41007 } health_report { overall_health: UNKNOWN } } }
I20260812 00:09:03.390149 9358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:03.388009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44784 (local address 127.19.59.66:41317)
0812 00:09:03.388056 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:03.388058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:03.388065 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:09:03.388090 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:03.388090 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:03.388104 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:03.388161 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:09:03.388269 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.388631 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.389350 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:03.389540 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:03.389604 (+ 64us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:03.389762 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:09:03.389904 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:09:03.389977 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:03.390030 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 00:09:03.390036 (+ 6us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:09:03.391763 8988 raft_consensus.cc:1261] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33 [term 1 FOLLOWER]: Refusing update from remote peer ddace4aa7f1e4869abdb94f2730e827f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:09:03.391773 9289 raft_consensus.cc:1261] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7 [term 1 FOLLOWER]: Refusing update from remote peer ddace4aa7f1e4869abdb94f2730e827f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:09:03.392078 9367 consensus_queue.cc:1035] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd4cdb506c334663bc08f8cabce57aa7" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:09:03.392195 9372 consensus_queue.cc:1035] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [LEADER]: Connected to new peer: Peer: permanent_uuid: "09cea41af7034e669c6567b3bed93e33" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 41007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:09:03.394377 9375 mvcc.cc:205] Tried to move back new op lower bound from 7317476734530195456 to 7317476734453657600. Current Snapshot: MvccSnapshot[applied={T|T < 7317476734530195456}]
I20260812 00:09:03.394909 9379 mvcc.cc:205] Tried to move back new op lower bound from 7317476734530195456 to 7317476734453657600. Current Snapshot: MvccSnapshot[applied={T|T < 7317476734530195456 or (T in {7317476734530195456})}]
I20260812 00:09:03.397080 8819 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:09:03.397176 8819 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:09:03.397913 8819 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d73b36179c8f4313a277eef5425f39e3: Sending DeleteTablet for 3 replicas of tablet caafb11bc7cf43829238d43d4596a10e
I20260812 00:09:03.398202 9118 tablet_service.cc:1514] Processing DeleteTablet for tablet caafb11bc7cf43829238d43d4596a10e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:03 UTC) from {username='slave'} at 127.0.0.1:44778
I20260812 00:09:03.398221 8967 tablet_service.cc:1514] Processing DeleteTablet for tablet caafb11bc7cf43829238d43d4596a10e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:03 UTC) from {username='slave'} at 127.0.0.1:40566
I20260812 00:09:03.398264 9268 tablet_service.cc:1514] Processing DeleteTablet for tablet caafb11bc7cf43829238d43d4596a10e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:03 UTC) from {username='slave'} at 127.0.0.1:44908
I20260812 00:09:03.398483 9386 tablet_replica.cc:330] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f: stopping tablet replica
I20260812 00:09:03.398546 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 8893
I20260812 00:09:03.398643 9387 tablet_replica.cc:330] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33: stopping tablet replica
I20260812 00:09:03.398752 9386 raft_consensus.cc:2229] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:09:03.398851 9387 raft_consensus.cc:2229] T caafb11bc7cf43829238d43d4596a10e P 09cea41af7034e669c6567b3bed93e33 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:09:03.399766 9386 raft_consensus.cc:2258] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:09:03.400895 9386 ts_tablet_manager.cc:1905] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:09:03.402504 9386 ts_tablet_manager.cc:1918] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:09:03.402626 9386 log.cc:1196] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/caafb11bc7cf43829238d43d4596a10e
I20260812 00:09:03.402967 9386 ts_tablet_manager.cc:1939] T caafb11bc7cf43829238d43d4596a10e P ddace4aa7f1e4869abdb94f2730e827f: Deleting consensus metadata
I20260812 00:09:03.403438 8803 catalog_manager.cc:4841] TS ddace4aa7f1e4869abdb94f2730e827f (127.19.59.66:41317): tablet caafb11bc7cf43829238d43d4596a10e (table test-table [id=bbcd15f774c04e1b9c6701d08dae9102]) successfully deleted
I20260812 00:09:03.407910 9388 tablet_replica.cc:330] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7: stopping tablet replica
W20260812 00:09:03.407892 8804 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:41007 (error 108)
I20260812 00:09:03.408023 9388 raft_consensus.cc:2229] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:09:03.408125 9388 raft_consensus.cc:2258] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:09:03.408438 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 9045
I20260812 00:09:03.408516 9354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:03.408410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:41007 (local address 127.0.0.1:40570)
0812 00:09:03.408453 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:03.408486 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:41007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 00:09:03.408537 9388 ts_tablet_manager.cc:1905] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 00:09:03.408691 8804 catalog_manager.cc:4584] TS 09cea41af7034e669c6567b3bed93e33 (127.19.59.65:41007): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet caafb11bc7cf43829238d43d4596a10e: Network error: Client connection negotiation failed: client connection to 127.19.59.65:41007: connect: Connection refused (error 111)
I20260812 00:09:03.410749 9388 ts_tablet_manager.cc:1918] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:09:03.410830 9388 log.cc:1196] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/caafb11bc7cf43829238d43d4596a10e
I20260812 00:09:03.411046 9388 ts_tablet_manager.cc:1939] T caafb11bc7cf43829238d43d4596a10e P cd4cdb506c334663bc08f8cabce57aa7: Deleting consensus metadata
I20260812 00:09:03.411526 8803 catalog_manager.cc:4841] TS cd4cdb506c334663bc08f8cabce57aa7 (127.19.59.67:33337): tablet caafb11bc7cf43829238d43d4596a10e (table test-table [id=bbcd15f774c04e1b9c6701d08dae9102]) successfully deleted
I20260812 00:09:03.414772 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 9196
I20260812 00:09:03.420368 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 8787
2026-08-12T00:09:03Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (945 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:03 dist-test-slave-6nmv krb5kdc[9392](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:03 dist-test-slave-6nmv krb5kdc[9392](info): set up 2 sockets
Aug 12 00:09:03 dist-test-slave-6nmv krb5kdc[9392](info): commencing operation
krb5kdc: starting...
W20260812 00:09:04.460784 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:04 dist-test-slave-6nmv krb5kdc[9392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:09:04.573104 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:40197
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:40197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:04.654505 9408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:04.654690 9408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:04.654711 9408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:04.655794 9408 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:04.655833 9408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:04.655845 9408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:04.655880 9408 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:04.655906 9408 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:04.657316 9408 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:40197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:40197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:04.657541 9408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:04.657753 9408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:04.662199 9413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:04.662216 9416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:04.662227 9414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:04.662655 9408 server_base.cc:1034] running on GCE node
I20260812 00:09:04.662863 9408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:04.663098 9408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:04.664248 9408 hybrid_clock.cc:648] HybridClock initialized: now 1786493344664231 us; error 32 us; skew 500 ppm
Aug 12 00:09:04 dist-test-slave-6nmv krb5kdc[9392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493344, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:04.666831 9408 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:09:04.667273 9408 webserver.cc:460] Webserver started at http://127.19.59.126:40421/ using document root <none> and password file <none>
I20260812 00:09:04.667484 9408 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:04.667553 9408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:04.667702 9408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:04.668674 9408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "c1ef6456502242429afc58e9c6623a87"
format_stamp: "Formatted at 2026-08-12 00:09:04 on dist-test-slave-6nmv"
server_key: "66af7f8ca43a5ceea7b368e7639401c4"
server_key_iv: "ac8d01a830ceeb4e1a37aff6873e2690"
server_key_version: "encryptionkey@0"
I20260812 00:09:04.669020 9408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "c1ef6456502242429afc58e9c6623a87"
format_stamp: "Formatted at 2026-08-12 00:09:04 on dist-test-slave-6nmv"
server_key: "66af7f8ca43a5ceea7b368e7639401c4"
server_key_iv: "ac8d01a830ceeb4e1a37aff6873e2690"
server_key_version: "encryptionkey@0"
I20260812 00:09:04.670342 9408 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:09:04.671072 9423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:04.671236 9408 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:09:04.671339 9408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "c1ef6456502242429afc58e9c6623a87"
format_stamp: "Formatted at 2026-08-12 00:09:04 on dist-test-slave-6nmv"
server_key: "66af7f8ca43a5ceea7b368e7639401c4"
server_key_iv: "ac8d01a830ceeb4e1a37aff6873e2690"
server_key_version: "encryptionkey@0"
I20260812 00:09:04.671422 9408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:04.693006 9408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:04.694963 9408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:04.695133 9408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:04.699275 9408 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:40197
I20260812 00:09:04.699307 9485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:40197 every 8 connection(s)
I20260812 00:09:04.699645 9408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:04.700495 9486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:04.702718 9486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87: Bootstrap starting.
I20260812 00:09:04.703373 9486 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:04.703668 9486 log.cc:824] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:04.704397 9486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87: No bootstrap required, opened a new log
I20260812 00:09:04.705915 9486 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ef6456502242429afc58e9c6623a87" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40197 } }
I20260812 00:09:04.706045 9486 raft_consensus.cc:374] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:04.706066 9486 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1ef6456502242429afc58e9c6623a87, State: Initialized, Role: FOLLOWER
I20260812 00:09:04.706239 9486 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ef6456502242429afc58e9c6623a87" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40197 } }
I20260812 00:09:04.706315 9486 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:04.706355 9486 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:04.706401 9486 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:04.706877 9486 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ef6456502242429afc58e9c6623a87" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40197 } }
I20260812 00:09:04.706988 9486 leader_election.cc:302] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1ef6456502242429afc58e9c6623a87; no voters:
I20260812 00:09:04.707203 9486 leader_election.cc:288] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:04.707252 9489 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:04.707438 9489 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [term 1 LEADER]: Becoming Leader. State: Replica: c1ef6456502242429afc58e9c6623a87, State: Running, Role: LEADER
I20260812 00:09:04.707479 9486 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:04.707521 9489 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ef6456502242429afc58e9c6623a87" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40197 } }
I20260812 00:09:04.707870 9490 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1ef6456502242429afc58e9c6623a87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ef6456502242429afc58e9c6623a87" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40197 } } }
I20260812 00:09:04.707952 9490 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:04.707994 9491 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1ef6456502242429afc58e9c6623a87. Latest consensus state: current_term: 1 leader_uuid: "c1ef6456502242429afc58e9c6623a87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ef6456502242429afc58e9c6623a87" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40197 } } }
I20260812 00:09:04.708061 9491 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:04.708189 9497 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:04.708452 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 9408
I20260812 00:09:04.708590 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:04.708719 9497 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:04.708825 19693 external_mini_cluster.cc:1428] Setting key 4c8555a68e1076c48d9942cd49be2bee
I20260812 00:09:04.710327 9497 catalog_manager.cc:1347] Generated new cluster ID: 2ba59ce5df4041508b948398fc77c300
I20260812 00:09:04.710377 9497 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:09:04 dist-test-slave-6nmv krb5kdc[9392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:04.718601 9510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:04.709422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49624 (local address 127.19.59.126:40197)
0812 00:09:04.709580 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:04.709587 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:04.709729 (+ 142us) server_negotiation.cc:407] Connection header received
0812 00:09:04.709872 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:04.709879 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:04.709944 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:04.710075 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:04.710804 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:04.711684 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:04.712419 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:04.712847 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:04.712966 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:04.715286 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:04.715290 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:04.715290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:04.715301 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:04.716930 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:04.717310 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:04.717313 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:04.717313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:04.717433 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:04.717669 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:04.717670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:04.717670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:04.717975 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:04.718139 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:04.718247 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 00:09:04.718392 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":70,"threads_started":1}
I20260812 00:09:04.738371 9497 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:04.738886 9497 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:04.747788 9497 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87: Generated new TSK 0
I20260812 00:09:04.748000 9497 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.59.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
Entry for principal kudu/127.19.59.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab.
I20260812 00:09:04.782534 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40197
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:04.878708 9514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:04.878921 9514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:04.878944 9514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:04.880105 9514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:04.880144 9514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:04.880169 9514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:09:04.881554 9514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.65.keytab
--principal=kudu/127.19.59.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:04.881719 9514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:04.881994 9514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:04.886976 9521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:04.886988 9520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:04.886988 9523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:04.887442 9514 server_base.cc:1034] running on GCE node
I20260812 00:09:04.887682 9514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:04.887931 9514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:04.889106 9514 hybrid_clock.cc:648] HybridClock initialized: now 1786493344889090 us; error 32 us; skew 500 ppm
Aug 12 00:09:04 dist-test-slave-6nmv krb5kdc[9392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493344, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:04.891738 9514 init.cc:377] Logged in from keytab as kudu/127.19.59.65@KRBTEST.COM (short username kudu)
I20260812 00:09:04.892221 9514 webserver.cc:460] Webserver started at http://127.19.59.65:34503/ using document root <none> and password file <none>
I20260812 00:09:04.892473 9514 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:04.892529 9514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:04.892676 9514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:04.893914 9514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "c4d13e85a8644571b109ee4d288d794f"
format_stamp: "Formatted at 2026-08-12 00:09:04 on dist-test-slave-6nmv"
server_key: "4dd23f2a44d05ed433832d953cf39a73"
server_key_iv: "3d143449d4cbcdb567051185bd330751"
server_key_version: "encryptionkey@0"
I20260812 00:09:04.894333 9514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "c4d13e85a8644571b109ee4d288d794f"
format_stamp: "Formatted at 2026-08-12 00:09:04 on dist-test-slave-6nmv"
server_key: "4dd23f2a44d05ed433832d953cf39a73"
server_key_iv: "3d143449d4cbcdb567051185bd330751"
server_key_version: "encryptionkey@0"
I20260812 00:09:04.895749 9514 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:09:04.896543 9533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:04.896724 9514 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:09:04.896802 9514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "c4d13e85a8644571b109ee4d288d794f"
format_stamp: "Formatted at 2026-08-12 00:09:04 on dist-test-slave-6nmv"
server_key: "4dd23f2a44d05ed433832d953cf39a73"
server_key_iv: "3d143449d4cbcdb567051185bd330751"
server_key_version: "encryptionkey@0"
I20260812 00:09:04.896849 9514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:04.914722 9514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:04.916846 9514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:04.916950 9514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:04.917115 9514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:09:04.917404 9514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:09:04.917438 9514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:04.917495 9514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:09:04.917526 9514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:04.923003 9514 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:44877
I20260812 00:09:04.923103 9662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:44877 every 8 connection(s)
I20260812 00:09:04.923410 9514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:09:04.927774 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 9514
I20260812 00:09:04.927899 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:09:04.928087 19693 external_mini_cluster.cc:1428] Setting key 67f815006efa74fe19a907bf16d9b059
Aug 12 00:09:04 dist-test-slave-6nmv krb5kdc[9392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493344, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.65@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:04.932261 9510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:04.924105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:33341 (local address 127.19.59.126:40197)
0812 00:09:04.924145 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:04.924147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:04.924377 (+ 230us) server_negotiation.cc:407] Connection header received
0812 00:09:04.924816 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:04.924817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:04.924831 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:04.924883 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:04.925691 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:04.926164 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:04.926992 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:04.927187 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:04.927231 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:04.929531 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:04.929532 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:04.929533 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:04.929539 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:04.930892 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:04.931282 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:04.931283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:04.931284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:04.931343 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:04.931582 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:04.931582 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:04.931583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:04.931714 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:04.931804 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:04.932072 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 00:09:04.932171 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:09:04.932395 9665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:04.924062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:40197 (local address 127.19.59.65:33341)
0812 00:09:04.924234 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:04.924285 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:04.924732 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:04.924938 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:04.924941 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:04.925460 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:04.925622 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:04.925627 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:04.926235 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:04.926236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:04.926925 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:04.926927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:04.927249 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:04.927250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:04.927331 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:04.927924 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:04.927932 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:04.929441 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:04.930990 (+ 1549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:04.930996 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:04.930998 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:04.931206 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:04.931412 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:04.931413 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:04.931413 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:04.931513 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:04.931795 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:04.931802 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:04.931935 (+ 133us) client_negotiation.cc:769] Sending connection context
0812 00:09:04.932035 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 00:09:04.932178 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":100,"threads_started":1}
I20260812 00:09:04.933210 9663 heartbeater.cc:347] Connected to a master server at 127.19.59.126:40197
I20260812 00:09:04.933287 9663 heartbeater.cc:464] Registering TS with master...
I20260812 00:09:04.933455 9663 heartbeater.cc:511] Master 127.19.59.126:40197 requested a full tablet report, sending...
I20260812 00:09:04.934010 9441 ts_manager.cc:194] Registered new tserver with Master: c4d13e85a8644571b109ee4d288d794f (127.19.59.65:44877)
I20260812 00:09:04.934599 9441 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.65@KRBTEST.COM'} at 127.19.59.65:33341
WARNING: no policy specified for kudu/127.19.59.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
Entry for principal kudu/127.19.59.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab.
I20260812 00:09:04.951920 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40197
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:05.027143 9669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:05.027324 9669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:05.027345 9669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:05.028388 9669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:05.028420 9669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:05.028458 9669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:09:05.029736 9669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.66.keytab
--principal=kudu/127.19.59.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:05.029964 9669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:05.030211 9669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:05.034946 9674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:05.034974 9675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:05.034955 9677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:05.035204 9669 server_base.cc:1034] running on GCE node
I20260812 00:09:05.035390 9669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:05.035655 9669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:05.036819 9669 hybrid_clock.cc:648] HybridClock initialized: now 1786493345036803 us; error 29 us; skew 500 ppm
Aug 12 00:09:05 dist-test-slave-6nmv krb5kdc[9392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493345, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:05.039326 9669 init.cc:377] Logged in from keytab as kudu/127.19.59.66@KRBTEST.COM (short username kudu)
I20260812 00:09:05.039705 9669 webserver.cc:460] Webserver started at http://127.19.59.66:39863/ using document root <none> and password file <none>
I20260812 00:09:05.039907 9669 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:05.039969 9669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:05.040112 9669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:05.041052 9669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "4720fd0abbaf4f568d7099876d94c9ff"
format_stamp: "Formatted at 2026-08-12 00:09:05 on dist-test-slave-6nmv"
server_key: "258aaa5f6ce9ae809aea6a1370bdc6fc"
server_key_iv: "1e8fae37ec313581737b62c983889a1b"
server_key_version: "encryptionkey@0"
I20260812 00:09:05.041395 9669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "4720fd0abbaf4f568d7099876d94c9ff"
format_stamp: "Formatted at 2026-08-12 00:09:05 on dist-test-slave-6nmv"
server_key: "258aaa5f6ce9ae809aea6a1370bdc6fc"
server_key_iv: "1e8fae37ec313581737b62c983889a1b"
server_key_version: "encryptionkey@0"
I20260812 00:09:05.042703 9669 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:09:05.043375 9686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:05.043553 9669 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:09:05.043650 9669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "4720fd0abbaf4f568d7099876d94c9ff"
format_stamp: "Formatted at 2026-08-12 00:09:05 on dist-test-slave-6nmv"
server_key: "258aaa5f6ce9ae809aea6a1370bdc6fc"
server_key_iv: "1e8fae37ec313581737b62c983889a1b"
server_key_version: "encryptionkey@0"
I20260812 00:09:05.043730 9669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:05.052217 9669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:05.053918 9669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:05.054066 9669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:05.054275 9669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:09:05.054579 9669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:09:05.054630 9669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:05.054666 9669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:09:05.054690 9669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:05.060168 9669 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:39343
I20260812 00:09:05.060212 9821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:39343 every 8 connection(s)
I20260812 00:09:05.060462 9669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:09:05 dist-test-slave-6nmv krb5kdc[9392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493345, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.66@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:05.066116 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 9669
I20260812 00:09:05.066229 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:09:05.066424 19693 external_mini_cluster.cc:1428] Setting key 0fa0807546c384aab0c040395a97ecd6
I20260812 00:09:05.069152 9510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.061068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:47743 (local address 127.19.59.126:40197)
0812 00:09:05.061139 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:05.061141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:05.061350 (+ 209us) server_negotiation.cc:407] Connection header received
0812 00:09:05.061734 (+ 384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:05.061735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:05.061744 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:05.061791 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:05.062661 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.063160 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.064038 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.064220 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.064281 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.066243 (+ 1962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:05.066249 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:05.066249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:05.066255 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:05.067718 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:05.068184 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:05.068185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:05.068186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:05.068236 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:05.068499 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:05.068499 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:05.068500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:05.068587 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:05.068633 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:05.068932 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 00:09:05.069039 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 00:09:05.069296 9824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.061027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:40197 (local address 127.19.59.66:47743)
0812 00:09:05.061242 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:05.061273 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:05.061660 (+ 387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:05.061888 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:05.061891 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:05.062413 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:05.062587 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.062591 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.063235 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.063236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.063968 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.063969 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.064301 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.064301 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.064402 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.064763 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:05.064770 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:05.066133 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:05.067810 (+ 1677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:05.067816 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:05.067818 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:05.068116 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:05.068311 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:05.068312 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:05.068312 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:05.068440 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:05.068645 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:05.068650 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:05.068791 (+ 141us) client_negotiation.cc:769] Sending connection context
0812 00:09:05.068898 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 00:09:05.069061 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":138,"threads_started":1}
I20260812 00:09:05.069716 9822 heartbeater.cc:347] Connected to a master server at 127.19.59.126:40197
I20260812 00:09:05.069850 9822 heartbeater.cc:464] Registering TS with master...
I20260812 00:09:05.070006 9822 heartbeater.cc:511] Master 127.19.59.126:40197 requested a full tablet report, sending...
I20260812 00:09:05.070359 9441 ts_manager.cc:194] Registered new tserver with Master: 4720fd0abbaf4f568d7099876d94c9ff (127.19.59.66:39343)
I20260812 00:09:05.070701 9441 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.66@KRBTEST.COM'} at 127.19.59.66:47743
WARNING: no policy specified for kudu/127.19.59.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
Entry for principal kudu/127.19.59.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab.
I20260812 00:09:05.090593 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40197
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:05.166399 9828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:05.166606 9828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:05.166644 9828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:05.167727 9828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:05.167789 9828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:05.167831 9828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:09:05.169204 9828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.67.keytab
--principal=kudu/127.19.59.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:40197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:05.169459 9828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:05.169679 9828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:05.174445 9835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:05.174444 9838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:05.174508 9834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:05.174764 9828 server_base.cc:1034] running on GCE node
I20260812 00:09:05.174978 9828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:05.175170 9828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:05.176331 9828 hybrid_clock.cc:648] HybridClock initialized: now 1786493345176317 us; error 25 us; skew 500 ppm
Aug 12 00:09:05 dist-test-slave-6nmv krb5kdc[9392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493345, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:05.178838 9828 init.cc:377] Logged in from keytab as kudu/127.19.59.67@KRBTEST.COM (short username kudu)
I20260812 00:09:05.179308 9828 webserver.cc:460] Webserver started at http://127.19.59.67:43177/ using document root <none> and password file <none>
I20260812 00:09:05.179474 9828 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:05.179517 9828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:05.179598 9828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:05.180490 9828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "ff233a9d7271423681689a12a3e57298"
format_stamp: "Formatted at 2026-08-12 00:09:05 on dist-test-slave-6nmv"
server_key: "942bf321dc01d5128f9d307e311246ef"
server_key_iv: "ec18b9bccb7759d311c8fe6663ccb9da"
server_key_version: "encryptionkey@0"
I20260812 00:09:05.180768 9828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "ff233a9d7271423681689a12a3e57298"
format_stamp: "Formatted at 2026-08-12 00:09:05 on dist-test-slave-6nmv"
server_key: "942bf321dc01d5128f9d307e311246ef"
server_key_iv: "ec18b9bccb7759d311c8fe6663ccb9da"
server_key_version: "encryptionkey@0"
I20260812 00:09:05.181950 9828 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:09:05.182674 9847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:05.182855 9828 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:05.182937 9828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "ff233a9d7271423681689a12a3e57298"
format_stamp: "Formatted at 2026-08-12 00:09:05 on dist-test-slave-6nmv"
server_key: "942bf321dc01d5128f9d307e311246ef"
server_key_iv: "ec18b9bccb7759d311c8fe6663ccb9da"
server_key_version: "encryptionkey@0"
I20260812 00:09:05.182988 9828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:05.202945 9828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:05.205004 9828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:05.205104 9828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:05.205242 9828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:09:05.205446 9828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:09:05.205470 9828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:05.205487 9828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:09:05.205499 9828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:05.211162 9828 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:33987
I20260812 00:09:05.211231 9978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:33987 every 8 connection(s)
I20260812 00:09:05.211531 9828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:09:05.214871 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 9828
I20260812 00:09:05.214987 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:09:05.215175 19693 external_mini_cluster.cc:1428] Setting key be01d90bf62bff38a5b71a541b386cc5
Aug 12 00:09:05 dist-test-slave-6nmv krb5kdc[9392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493345, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.67@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:05.219717 9510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.212166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:53163 (local address 127.19.59.126:40197)
0812 00:09:05.212240 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:05.212242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:05.212416 (+ 174us) server_negotiation.cc:407] Connection header received
0812 00:09:05.212832 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:05.212833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:05.212843 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:05.212893 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:05.213730 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.214216 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.215122 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.215370 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.215457 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.217388 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:05.217389 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:05.217390 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:05.217395 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:05.218657 (+ 1262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:05.219004 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:05.219005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:05.219005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:05.219052 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:05.219272 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:05.219273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:05.219273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:05.219360 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:05.219417 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:05.219609 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 00:09:05.219662 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 00:09:05.219852 9981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.212144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:40197 (local address 127.19.59.67:53163)
0812 00:09:05.212311 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:05.212341 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:05.212759 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:05.212938 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:05.212940 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:05.213479 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:05.213658 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.213662 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.214312 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.214313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.215047 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.215050 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.215494 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.215494 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.215642 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.216129 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:05.216137 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:05.217305 (+ 1168us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:05.218722 (+ 1417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:05.218728 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:05.218729 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:05.218922 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:05.219104 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:05.219105 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:05.219105 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:05.219223 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:05.219420 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:05.219423 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:05.219508 (+ 85us) client_negotiation.cc:769] Sending connection context
0812 00:09:05.219582 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 00:09:05.219677 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":108,"threads_started":1}
I20260812 00:09:05.220259 9979 heartbeater.cc:347] Connected to a master server at 127.19.59.126:40197
I20260812 00:09:05.220340 9979 heartbeater.cc:464] Registering TS with master...
I20260812 00:09:05.220458 9979 heartbeater.cc:511] Master 127.19.59.126:40197 requested a full tablet report, sending...
I20260812 00:09:05.220769 9441 ts_manager.cc:194] Registered new tserver with Master: ff233a9d7271423681689a12a3e57298 (127.19.59.67:33987)
I20260812 00:09:05.221107 9441 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.59.67@KRBTEST.COM'} at 127.19.59.67:53163
I20260812 00:09:05.226691 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:09:05.232681 9510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.227772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49640 (local address 127.19.59.126:40197)
0812 00:09:05.227837 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:05.227838 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:05.227933 (+ 95us) server_negotiation.cc:407] Connection header received
0812 00:09:05.227964 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:05.227964 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:05.227971 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:05.228019 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:05.228465 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.228829 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.229427 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.229580 (+ 153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.229626 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.230563 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:05.230564 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:05.230564 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:05.230569 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:05.231895 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:05.232176 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:05.232177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:05.232177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:05.232222 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:05.232343 (+ 121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:05.232344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:05.232344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:05.232451 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:05.232518 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:05.232580 (+ 62us) server_negotiation.cc:299] Negotiation successful
0812 00:09:05.232630 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 00:09:05.234313 9441 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49640:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:09:05.235656 9441 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:09:05.241065 9988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.237455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:39343 (local address 127.0.0.1:57974)
0812 00:09:05.237978 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:05.237992 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:05.238051 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:05.238263 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:05.238264 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:05.238265 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:05.238326 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.238327 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.239104 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.239105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.240180 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.240182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.240812 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.240813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.240881 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.240892 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:09:05.240955 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:09:05.241005 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"mutex_wait_us":2,"thread_start_us":49,"threads_started":1}
I20260812 00:09:05.241088 9993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.237665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57974 (local address 127.19.59.66:39343)
0812 00:09:05.237863 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:05.237868 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:05.238062 (+ 194us) server_negotiation.cc:407] Connection header received
0812 00:09:05.238115 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:05.238117 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:05.238129 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:05.238188 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:05.238416 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.239011 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.240263 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.240732 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.240810 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.240865 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:05.240972 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 00:09:05.241021 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":82,"threads_started":1}
I20260812 00:09:05.241330 9990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.237450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:44877 (local address 127.0.0.1:38284)
0812 00:09:05.237763 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:05.237793 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:05.237892 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:05.238127 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:05.238129 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:05.238131 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:05.238263 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.238265 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.239330 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.239331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.240283 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.240285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.241134 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.241135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.241189 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.241192 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:09:05.241231 (+ 39us) client_negotiation.cc:240] Negotiation successful
0812 00:09:05.241267 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":29,"thread_start_us":61,"threads_started":1}
I20260812 00:09:05.241348 9991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.237602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60632 (local address 127.19.59.67:33987)
0812 00:09:05.237746 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:05.237750 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:05.237917 (+ 167us) server_negotiation.cc:407] Connection header received
0812 00:09:05.237972 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:05.237973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:05.237987 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:05.238059 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:05.238277 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.239185 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.240270 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.240861 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.240902 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.240945 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:05.241165 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 00:09:05.241199 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":91,"threads_started":1}
I20260812 00:09:05.241540 9989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.237450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:33987 (local address 127.0.0.1:60632)
0812 00:09:05.237861 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:05.237869 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:05.237915 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:05.238126 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:05.238129 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:05.238133 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:05.238201 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.238203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.239292 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.239293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.240188 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.240191 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.241002 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.241003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.241081 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.241084 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:09:05.241452 (+ 368us) client_negotiation.cc:240] Negotiation successful
0812 00:09:05.241490 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":50,"thread_start_us":55,"threads_started":1}
I20260812 00:09:05.241596 9992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.237679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38284 (local address 127.19.59.65:44877)
0812 00:09:05.237902 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:05.237905 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:05.237937 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:09:05.237973 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:05.237974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:05.237987 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:05.238055 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:05.238336 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.239244 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.240339 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.241003 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.241062 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.241106 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:05.241474 (+ 368us) server_negotiation.cc:299] Negotiation successful
0812 00:09:05.241510 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":72,"threads_started":1}
I20260812 00:09:05.241906 9742 tablet_service.cc:1467] Processing CreateTablet for tablet ac69399cccfc4ef295560712aefa7a20 (DEFAULT_TABLE table=test-table [id=62d77a53361c4a6f8aa819528deae8cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:09:05.242223 9742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac69399cccfc4ef295560712aefa7a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:05.242143 9585 tablet_service.cc:1467] Processing CreateTablet for tablet ac69399cccfc4ef295560712aefa7a20 (DEFAULT_TABLE table=test-table [id=62d77a53361c4a6f8aa819528deae8cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:09:05.242396 9585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac69399cccfc4ef295560712aefa7a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:05.242350 9904 tablet_service.cc:1467] Processing CreateTablet for tablet ac69399cccfc4ef295560712aefa7a20 (DEFAULT_TABLE table=test-table [id=62d77a53361c4a6f8aa819528deae8cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:09:05.242621 9904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac69399cccfc4ef295560712aefa7a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:05.244783 9994 tablet_bootstrap.cc:492] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298: Bootstrap starting.
I20260812 00:09:05.245545 9994 tablet_bootstrap.cc:654] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:05.245522 9996 tablet_bootstrap.cc:492] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff: Bootstrap starting.
I20260812 00:09:05.245639 9995 tablet_bootstrap.cc:492] T ac69399cccfc4ef295560712aefa7a20 P c4d13e85a8644571b109ee4d288d794f: Bootstrap starting.
I20260812 00:09:05.246042 9994 log.cc:824] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:05.246150 9996 tablet_bootstrap.cc:654] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:05.246189 9995 tablet_bootstrap.cc:654] T ac69399cccfc4ef295560712aefa7a20 P c4d13e85a8644571b109ee4d288d794f: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:05.246685 9994 tablet_bootstrap.cc:492] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298: No bootstrap required, opened a new log
I20260812 00:09:05.246760 9994 ts_tablet_manager.cc:1397] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:09:05.246762 9995 log.cc:824] T ac69399cccfc4ef295560712aefa7a20 P c4d13e85a8644571b109ee4d288d794f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:05.246762 9996 log.cc:824] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:05.247466 9995 tablet_bootstrap.cc:492] T ac69399cccfc4ef295560712aefa7a20 P c4d13e85a8644571b109ee4d288d794f: No bootstrap required, opened a new log
I20260812 00:09:05.247560 9995 ts_tablet_manager.cc:1397] T ac69399cccfc4ef295560712aefa7a20 P c4d13e85a8644571b109ee4d288d794f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:09:05.247713 9996 tablet_bootstrap.cc:492] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff: No bootstrap required, opened a new log
I20260812 00:09:05.247768 9996 ts_tablet_manager.cc:1397] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:09:05.248401 9994 raft_consensus.cc:348] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff233a9d7271423681689a12a3e57298" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33987 } } peers { permanent_uuid: "c4d13e85a8644571b109ee4d288d794f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44877 } } peers { permanent_uuid: "4720fd0abbaf4f568d7099876d94c9ff" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39343 } }
I20260812 00:09:05.248584 9994 raft_consensus.cc:374] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:05.248624 9994 raft_consensus.cc:729] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff233a9d7271423681689a12a3e57298, State: Initialized, Role: FOLLOWER
I20260812 00:09:05.248749 9994 consensus_queue.cc:260] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff233a9d7271423681689a12a3e57298" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33987 } } peers { permanent_uuid: "c4d13e85a8644571b109ee4d288d794f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44877 } } peers { permanent_uuid: "4720fd0abbaf4f568d7099876d94c9ff" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39343 } }
I20260812 00:09:05.249012 9994 ts_tablet_manager.cc:1428] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:09:05.249140 9979 heartbeater.cc:503] Master 127.19.59.126:40197 was elected leader, sending a full tablet report...
I20260812 00:09:05.249424 9996 raft_consensus.cc:348] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff233a9d7271423681689a12a3e57298" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33987 } } peers { permanent_uuid: "c4d13e85a8644571b109ee4d288d794f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44877 } } peers { permanent_uuid: "4720fd0abbaf4f568d7099876d94c9ff" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39343 } }
I20260812 00:09:05.249578 9996 raft_consensus.cc:374] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:05.249619 9996 raft_consensus.cc:729] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4720fd0abbaf4f568d7099876d94c9ff, State: Initialized, Role: FOLLOWER
I20260812 00:09:05.249754 9996 consensus_queue.cc:260] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff233a9d7271423681689a12a3e57298" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33987 } } peers { permanent_uuid: "c4d13e85a8644571b109ee4d288d794f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44877 } } peers { permanent_uuid: "4720fd0abbaf4f568d7099876d94c9ff" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39343 } }
I20260812 00:09:05.250028 9822 heartbeater.cc:503] Master 127.19.59.126:40197 was elected leader, sending a full tablet report...
I20260812 00:09:05.250028 9996 ts_tablet_manager.cc:1428] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:09:05.249717 9995 raft_consensus.cc:348] T ac69399cccfc4ef295560712aefa7a20 P c4d13e85a8644571b109ee4d288d794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff233a9d7271423681689a12a3e57298" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33987 } } peers { permanent_uuid: "c4d13e85a8644571b109ee4d288d794f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44877 } } peers { permanent_uuid: "4720fd0abbaf4f568d7099876d94c9ff" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39343 } }
I20260812 00:09:05.250298 9995 raft_consensus.cc:374] T ac69399cccfc4ef295560712aefa7a20 P c4d13e85a8644571b109ee4d288d794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:05.250345 9995 raft_consensus.cc:729] T ac69399cccfc4ef295560712aefa7a20 P c4d13e85a8644571b109ee4d288d794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4d13e85a8644571b109ee4d288d794f, State: Initialized, Role: FOLLOWER
I20260812 00:09:05.250447 9995 consensus_queue.cc:260] T ac69399cccfc4ef295560712aefa7a20 P c4d13e85a8644571b109ee4d288d794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff233a9d7271423681689a12a3e57298" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33987 } } peers { permanent_uuid: "c4d13e85a8644571b109ee4d288d794f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44877 } } peers { permanent_uuid: "4720fd0abbaf4f568d7099876d94c9ff" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39343 } }
I20260812 00:09:05.250691 9995 ts_tablet_manager.cc:1428] T ac69399cccfc4ef295560712aefa7a20 P c4d13e85a8644571b109ee4d288d794f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:09:05.250713 9663 heartbeater.cc:503] Master 127.19.59.126:40197 was elected leader, sending a full tablet report...
W20260812 00:09:05.310931 9823 tablet.cc:2369] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:09:05.424197 9664 tablet.cc:2369] T ac69399cccfc4ef295560712aefa7a20 P c4d13e85a8644571b109ee4d288d794f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:09:05.462080 9980 tablet.cc:2369] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:09:05.516949 10000 raft_consensus.cc:482] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:09:05.517105 10000 raft_consensus.cc:504] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff233a9d7271423681689a12a3e57298" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33987 } } peers { permanent_uuid: "c4d13e85a8644571b109ee4d288d794f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44877 } } peers { permanent_uuid: "4720fd0abbaf4f568d7099876d94c9ff" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39343 } }
I20260812 00:09:05.517580 10000 leader_election.cc:288] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4d13e85a8644571b109ee4d288d794f (127.19.59.65:44877), 4720fd0abbaf4f568d7099876d94c9ff (127.19.59.66:39343)
I20260812 00:09:05.520113 9992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.517765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:54939 (local address 127.19.59.65:44877)
0812 00:09:05.517809 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:05.517811 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:05.517822 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:09:05.517910 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:05.517911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:05.517924 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:05.517971 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:05.518149 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.518594 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.519432 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.519769 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.519847 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.519855 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:05.520018 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 00:09:05.520053 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:09:05.520113 9981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.517728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:44877 (local address 127.19.59.67:54939)
0812 00:09:05.517765 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:05.517777 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:05.517837 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:05.517997 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:05.517999 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:05.518000 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:05.518079 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.518080 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.518680 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.518681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.519341 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.519343 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.519856 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.519857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.519931 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.519935 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:09:05.520007 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 00:09:05.520047 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260812 00:09:05.520241 10003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.517750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:39343 (local address 127.19.59.67:49987)
0812 00:09:05.517949 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:05.517961 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:05.518017 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:05.518181 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:05.518182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:05.518184 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:05.518251 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.518254 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.518814 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.518814 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.519471 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.519473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.519992 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.519993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.520068 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.520072 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:09:05.520133 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 00:09:05.520168 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":119,"threads_started":1}
I20260812 00:09:05.520228 9993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.517842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:49987 (local address 127.19.59.66:39343)
0812 00:09:05.517903 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:05.517904 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:05.518009 (+ 105us) server_negotiation.cc:407] Connection header received
0812 00:09:05.518090 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:05.518091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:05.518106 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:05.518177 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:05.518324 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.518733 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.519568 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.519911 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.519992 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.520000 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:05.520138 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 00:09:05.520170 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:09:05.520448 9612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac69399cccfc4ef295560712aefa7a20" candidate_uuid: "ff233a9d7271423681689a12a3e57298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4d13e85a8644571b109ee4d288d794f" is_pre_election: true
I20260812 00:09:05.520560 9768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac69399cccfc4ef295560712aefa7a20" candidate_uuid: "ff233a9d7271423681689a12a3e57298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4720fd0abbaf4f568d7099876d94c9ff" is_pre_election: true
I20260812 00:09:05.520609 9612 raft_consensus.cc:2454] T ac69399cccfc4ef295560712aefa7a20 P c4d13e85a8644571b109ee4d288d794f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff233a9d7271423681689a12a3e57298 in term 0.
I20260812 00:09:05.520732 9768 raft_consensus.cc:2454] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff233a9d7271423681689a12a3e57298 in term 0.
I20260812 00:09:05.520871 9850 leader_election.cc:302] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4d13e85a8644571b109ee4d288d794f, ff233a9d7271423681689a12a3e57298; no voters:
I20260812 00:09:05.521020 10000 raft_consensus.cc:2781] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:09:05.521082 10000 raft_consensus.cc:482] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:09:05.521097 10000 raft_consensus.cc:3037] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:05.521773 10000 raft_consensus.cc:504] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff233a9d7271423681689a12a3e57298" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33987 } } peers { permanent_uuid: "c4d13e85a8644571b109ee4d288d794f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44877 } } peers { permanent_uuid: "4720fd0abbaf4f568d7099876d94c9ff" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39343 } }
I20260812 00:09:05.521935 10000 leader_election.cc:288] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [CANDIDATE]: Term 1 election: Requested vote from peers c4d13e85a8644571b109ee4d288d794f (127.19.59.65:44877), 4720fd0abbaf4f568d7099876d94c9ff (127.19.59.66:39343)
I20260812 00:09:05.522122 9612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac69399cccfc4ef295560712aefa7a20" candidate_uuid: "ff233a9d7271423681689a12a3e57298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4d13e85a8644571b109ee4d288d794f"
I20260812 00:09:05.522125 9768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac69399cccfc4ef295560712aefa7a20" candidate_uuid: "ff233a9d7271423681689a12a3e57298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4720fd0abbaf4f568d7099876d94c9ff"
I20260812 00:09:05.522197 9768 raft_consensus.cc:3037] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:05.522197 9612 raft_consensus.cc:3037] T ac69399cccfc4ef295560712aefa7a20 P c4d13e85a8644571b109ee4d288d794f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:05.523030 9768 raft_consensus.cc:2454] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff233a9d7271423681689a12a3e57298 in term 1.
I20260812 00:09:05.523023 9612 raft_consensus.cc:2454] T ac69399cccfc4ef295560712aefa7a20 P c4d13e85a8644571b109ee4d288d794f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff233a9d7271423681689a12a3e57298 in term 1.
I20260812 00:09:05.523228 9848 leader_election.cc:302] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4720fd0abbaf4f568d7099876d94c9ff, ff233a9d7271423681689a12a3e57298; no voters:
I20260812 00:09:05.523334 10000 raft_consensus.cc:2781] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:05.523509 10000 raft_consensus.cc:686] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [term 1 LEADER]: Becoming Leader. State: Replica: ff233a9d7271423681689a12a3e57298, State: Running, Role: LEADER
I20260812 00:09:05.523612 10000 consensus_queue.cc:237] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff233a9d7271423681689a12a3e57298" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33987 } } peers { permanent_uuid: "c4d13e85a8644571b109ee4d288d794f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44877 } } peers { permanent_uuid: "4720fd0abbaf4f568d7099876d94c9ff" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39343 } }
I20260812 00:09:05.524408 9441 catalog_manager.cc:5495] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff233a9d7271423681689a12a3e57298 (127.19.59.67). New cstate: current_term: 1 leader_uuid: "ff233a9d7271423681689a12a3e57298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff233a9d7271423681689a12a3e57298" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 33987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4d13e85a8644571b109ee4d288d794f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4720fd0abbaf4f568d7099876d94c9ff" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39343 } health_report { overall_health: UNKNOWN } } }
I20260812 00:09:05.591578 9991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.589165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60646 (local address 127.19.59.67:33987)
0812 00:09:05.589214 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:05.589216 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:05.589226 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:09:05.589296 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:05.589297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:05.589315 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:05.589392 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:09:05.589540 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.590048 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.590800 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.590983 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.591054 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.591247 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:09:05.591343 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:09:05.591435 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:05.591454 (+ 19us) server_negotiation.cc:299] Negotiation successful
0812 00:09:05.591474 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:09:05.593528 9768 raft_consensus.cc:1261] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff [term 1 FOLLOWER]: Refusing update from remote peer ff233a9d7271423681689a12a3e57298: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:09:05.593528 9612 raft_consensus.cc:1261] T ac69399cccfc4ef295560712aefa7a20 P c4d13e85a8644571b109ee4d288d794f [term 1 FOLLOWER]: Refusing update from remote peer ff233a9d7271423681689a12a3e57298: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:09:05.593964 10004 consensus_queue.cc:1035] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4d13e85a8644571b109ee4d288d794f" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 44877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:09:05.594095 10000 consensus_queue.cc:1035] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4720fd0abbaf4f568d7099876d94c9ff" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 39343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:09:05.596601 10010 mvcc.cc:205] Tried to move back new op lower bound from 7317476743547760640 to 7317476743265181696. Current Snapshot: MvccSnapshot[applied={T|T < 7317476743547760640 or (T in {7317476743547760640})}]
I20260812 00:09:05.597406 10009 mvcc.cc:205] Tried to move back new op lower bound from 7317476743547760640 to 7317476743265181696. Current Snapshot: MvccSnapshot[applied={T|T < 7317476743547760640 or (T in {7317476743547760640})}]
I20260812 00:09:05.598409 9438 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:09:05.598526 9438 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:09:05.599299 9438 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c1ef6456502242429afc58e9c6623a87: Sending DeleteTablet for 3 replicas of tablet ac69399cccfc4ef295560712aefa7a20
I20260812 00:09:05.599627 9742 tablet_service.cc:1514] Processing DeleteTablet for tablet ac69399cccfc4ef295560712aefa7a20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:05 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:57974
I20260812 00:09:05.599684 9904 tablet_service.cc:1514] Processing DeleteTablet for tablet ac69399cccfc4ef295560712aefa7a20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:05 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:60632
I20260812 00:09:05.599745 9585 tablet_service.cc:1514] Processing DeleteTablet for tablet ac69399cccfc4ef295560712aefa7a20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:05 UTC) from {username='kudu', principal='kudu/127.19.59.126@KRBTEST.COM'} at 127.0.0.1:38284
I20260812 00:09:05.599864 10019 tablet_replica.cc:330] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298: stopping tablet replica
I20260812 00:09:05.599953 10019 raft_consensus.cc:2229] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:09:05.600045 10019 raft_consensus.cc:2258] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:09:05.600225 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 9514
I20260812 00:09:05.600319 10017 tablet_replica.cc:330] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff: stopping tablet replica
I20260812 00:09:05.600442 10017 raft_consensus.cc:2229] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:09:05.600443 10019 ts_tablet_manager.cc:1905] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:09:05.600634 10017 raft_consensus.cc:2258] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:09:05.602046 10017 ts_tablet_manager.cc:1905] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:09:05.602169 10019 ts_tablet_manager.cc:1918] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:09:05.602236 10019 log.cc:1196] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/ac69399cccfc4ef295560712aefa7a20
I20260812 00:09:05.602530 10019 ts_tablet_manager.cc:1939] T ac69399cccfc4ef295560712aefa7a20 P ff233a9d7271423681689a12a3e57298: Deleting consensus metadata
I20260812 00:09:05.602900 9425 catalog_manager.cc:4841] TS ff233a9d7271423681689a12a3e57298 (127.19.59.67:33987): tablet ac69399cccfc4ef295560712aefa7a20 (table test-table [id=62d77a53361c4a6f8aa819528deae8cd]) successfully deleted
I20260812 00:09:05.603765 10017 ts_tablet_manager.cc:1918] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:09:05.603856 10017 log.cc:1196] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/ac69399cccfc4ef295560712aefa7a20
I20260812 00:09:05.604090 10017 ts_tablet_manager.cc:1939] T ac69399cccfc4ef295560712aefa7a20 P 4720fd0abbaf4f568d7099876d94c9ff: Deleting consensus metadata
I20260812 00:09:05.604496 9424 catalog_manager.cc:4841] TS 4720fd0abbaf4f568d7099876d94c9ff (127.19.59.66:39343): tablet ac69399cccfc4ef295560712aefa7a20 (table test-table [id=62d77a53361c4a6f8aa819528deae8cd]) successfully deleted
W20260812 00:09:05.609647 9426 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:44877 (error 108)
I20260812 00:09:05.609958 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 9669
I20260812 00:09:05.619001 9990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.618866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:44877 (local address 127.0.0.1:38288)
0812 00:09:05.618918 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:05.618960 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:44877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 00:09:05.619122 9426 catalog_manager.cc:4584] TS c4d13e85a8644571b109ee4d288d794f (127.19.59.65:44877): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ac69399cccfc4ef295560712aefa7a20: Network error: Client connection negotiation failed: client connection to 127.19.59.65:44877: connect: Connection refused (error 111)
I20260812 00:09:05.622089 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 9828
I20260812 00:09:05.626894 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 9408
2026-08-12T00:09:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2206 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T00:09:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:05Z Disabled control of system clock
I20260812 00:09:05.655242 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:35217
--webserver_interface=127.19.59.126
--webserver_port=0
--builtin_ntp_servers=127.19.59.84:37153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:35217
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:09:05.729905 10025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:05.730088 10025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:05.730108 10025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:05.731189 10025 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:05.731230 10025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:05.731242 10025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:05.731276 10025 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:05.731305 10025 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:05.732610 10025 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:35217
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:35217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:05.732847 10025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:05.733124 10025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:05.737637 10033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:05.737620 10031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:05.737608 10030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:05.737840 10025 server_base.cc:1034] running on GCE node
I20260812 00:09:05.738131 10025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:05.738395 10025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:05.739557 10025 hybrid_clock.cc:648] HybridClock initialized: now 1786493345739549 us; error 46 us; skew 500 ppm
I20260812 00:09:05.740649 10025 webserver.cc:460] Webserver started at http://127.19.59.126:41833/ using document root <none> and password file <none>
I20260812 00:09:05.740890 10025 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:05.740958 10025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:05.741117 10025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:05.742137 10025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "72c39c4e37a64901951518e001c87eff"
format_stamp: "Formatted at 2026-08-12 00:09:05 on dist-test-slave-6nmv"
server_key: "97eaab4c9ea5728e6146d8f70dfb4ee8"
server_key_iv: "4ef48bf959e81692357c39db938e108b"
server_key_version: "encryptionkey@0"
I20260812 00:09:05.742468 10025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "72c39c4e37a64901951518e001c87eff"
format_stamp: "Formatted at 2026-08-12 00:09:05 on dist-test-slave-6nmv"
server_key: "97eaab4c9ea5728e6146d8f70dfb4ee8"
server_key_iv: "4ef48bf959e81692357c39db938e108b"
server_key_version: "encryptionkey@0"
I20260812 00:09:05.743696 10025 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:09:05.744380 10039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:05.744550 10025 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:05.744647 10025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "72c39c4e37a64901951518e001c87eff"
format_stamp: "Formatted at 2026-08-12 00:09:05 on dist-test-slave-6nmv"
server_key: "97eaab4c9ea5728e6146d8f70dfb4ee8"
server_key_iv: "4ef48bf959e81692357c39db938e108b"
server_key_version: "encryptionkey@0"
I20260812 00:09:05.744721 10025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:05.757617 10025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:05.757946 10025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:05.758092 10025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:05.761569 10025 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:35217
I20260812 00:09:05.761602 10100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:35217 every 8 connection(s)
I20260812 00:09:05.761956 10025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:05.762850 10101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:05.764876 10101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff: Bootstrap starting.
I20260812 00:09:05.765434 10101 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:05.765719 10101 log.cc:824] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:05.766325 10101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff: No bootstrap required, opened a new log
I20260812 00:09:05.767649 10101 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72c39c4e37a64901951518e001c87eff" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35217 } }
I20260812 00:09:05.767761 10101 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:05.767810 10101 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72c39c4e37a64901951518e001c87eff, State: Initialized, Role: FOLLOWER
I20260812 00:09:05.767973 10101 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72c39c4e37a64901951518e001c87eff" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35217 } }
I20260812 00:09:05.768057 10101 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:05.768102 10101 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:05.768147 10101 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:05.768589 10101 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72c39c4e37a64901951518e001c87eff" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35217 } }
I20260812 00:09:05.768690 10101 leader_election.cc:302] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72c39c4e37a64901951518e001c87eff; no voters:
I20260812 00:09:05.768865 10101 leader_election.cc:288] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:05.768929 10104 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:05.769079 10104 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [term 1 LEADER]: Becoming Leader. State: Replica: 72c39c4e37a64901951518e001c87eff, State: Running, Role: LEADER
I20260812 00:09:05.769169 10104 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72c39c4e37a64901951518e001c87eff" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35217 } }
I20260812 00:09:05.769191 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 10025
I20260812 00:09:05.769276 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:05.769459 19693 external_mini_cluster.cc:1428] Setting key bdc08166b48f58a44b6cf2dd27d164c2
I20260812 00:09:05.769455 10105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72c39c4e37a64901951518e001c87eff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72c39c4e37a64901951518e001c87eff" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35217 } } }
I20260812 00:09:05.769542 10106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72c39c4e37a64901951518e001c87eff. Latest consensus state: current_term: 1 leader_uuid: "72c39c4e37a64901951518e001c87eff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72c39c4e37a64901951518e001c87eff" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35217 } } }
I20260812 00:09:05.769603 10106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:05.769650 10101 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:05.769546 10105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:05.770354 10109 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:05.770879 10109 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:05.772307 10109 catalog_manager.cc:1347] Generated new cluster ID: 50877d09ff2f4ed9b92cf9cc76aeab02
I20260812 00:09:05.772360 10109 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:05.774914 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.770040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52776 (local address 127.19.59.126:35217)
0812 00:09:05.770233 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:05.770240 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:05.770270 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:09:05.770450 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:05.770458 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:05.770518 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:05.770654 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:05.771055 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.772367 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.773104 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.773534 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.773662 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.774310 (+ 648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:05.774313 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:05.774314 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:05.774483 (+ 169us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:05.774512 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:05.774521 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:05.774599 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:05.774665 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 00:09:05.774737 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":89,"threads_started":1}
I20260812 00:09:05.782764 10109 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:05.783420 10109 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:05.802361 10109 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff: Generated new TSK 0
I20260812 00:09:05.802500 10109 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:05.804497 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.65:0
--local_ip_for_outbound_sockets=127.19.59.65
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35217
--builtin_ntp_servers=127.19.59.84:37153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:09:05.888227 10127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:05.888438 10127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:05.888470 10127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:05.889521 10127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:05.889585 10127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:05.889628 10127 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.65
I20260812 00:09:05.891001 10127 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.59.65
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.65
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:05.891255 10127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:05.891525 10127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:05.897383 10134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:05.897394 10137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:05.897389 10133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:05.897964 10127 server_base.cc:1034] running on GCE node
I20260812 00:09:05.898164 10127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:05.898401 10127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:05.899549 10127 hybrid_clock.cc:648] HybridClock initialized: now 1786493345899524 us; error 39 us; skew 500 ppm
I20260812 00:09:05.900745 10127 webserver.cc:460] Webserver started at http://127.19.59.65:44381/ using document root <none> and password file <none>
I20260812 00:09:05.900969 10127 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:05.901041 10127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:05.901166 10127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:05.902197 10127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/data/instance:
uuid: "603b5106201f4f81b40e622785fb938c"
format_stamp: "Formatted at 2026-08-12 00:09:05 on dist-test-slave-6nmv"
server_key: "4e770f42d9586511134ec69edfea99f6"
server_key_iv: "74029c6aba3d789502e7efc8832416ee"
server_key_version: "encryptionkey@0"
I20260812 00:09:05.902529 10127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance:
uuid: "603b5106201f4f81b40e622785fb938c"
format_stamp: "Formatted at 2026-08-12 00:09:05 on dist-test-slave-6nmv"
server_key: "4e770f42d9586511134ec69edfea99f6"
server_key_iv: "74029c6aba3d789502e7efc8832416ee"
server_key_version: "encryptionkey@0"
I20260812 00:09:05.903837 10127 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:09:05.904670 10143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:05.904860 10127 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:09:05.904943 10127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/wal
uuid: "603b5106201f4f81b40e622785fb938c"
format_stamp: "Formatted at 2026-08-12 00:09:05 on dist-test-slave-6nmv"
server_key: "4e770f42d9586511134ec69edfea99f6"
server_key_iv: "74029c6aba3d789502e7efc8832416ee"
server_key_version: "encryptionkey@0"
I20260812 00:09:05.905025 10127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:05.922902 10127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:05.923233 10127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:05.923394 10127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:05.923640 10127 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:09:05.923986 10127 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:09:05.924045 10127 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:05.924078 10127 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:09:05.924108 10127 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:05.929710 10127 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.65:42195
I20260812 00:09:05.929754 10271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.65:42195 every 8 connection(s)
I20260812 00:09:05.930054 10127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/data/info.pb
I20260812 00:09:05.930322 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 10127
I20260812 00:09:05.930431 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-0/wal/instance
I20260812 00:09:05.930655 19693 external_mini_cluster.cc:1428] Setting key 645d2568f3724f3b3964ecb4f5c0b3dc
I20260812 00:09:05.931708 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.66:0
--local_ip_for_outbound_sockets=127.19.59.66
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35217
--builtin_ntp_servers=127.19.59.84:37153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:09:05.935293 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.930802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.65:47049 (local address 127.19.59.126:35217)
0812 00:09:05.930888 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:05.930890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:05.931109 (+ 219us) server_negotiation.cc:407] Connection header received
0812 00:09:05.931683 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:05.931684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:05.931698 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:05.931785 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:05.932435 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.932920 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.933927 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.934130 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.934241 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.935064 (+ 823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:05.935065 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:05.935065 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:05.935070 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:05.935085 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:05.935089 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:05.935136 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:05.935215 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 00:09:05.935239 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:09:05.935560 10274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:05.930730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:35217 (local address 127.19.59.65:47049)
0812 00:09:05.930963 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:05.931004 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:05.931545 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:05.931861 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:05.931865 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:05.931875 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:05.932337 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.932341 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.933014 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.933015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.933854 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:05.933857 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:05.934248 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:05.934250 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:05.934428 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:05.934928 (+ 500us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:09:05.934929 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:05.934963 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:09:05.934989 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:05.935152 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:05.935157 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:05.935160 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:09:05.935220 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:09:05.935322 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":83,"threads_started":1}
I20260812 00:09:05.936126 10272 heartbeater.cc:347] Connected to a master server at 127.19.59.126:35217
I20260812 00:09:05.936237 10272 heartbeater.cc:464] Registering TS with master...
I20260812 00:09:05.936448 10272 heartbeater.cc:511] Master 127.19.59.126:35217 requested a full tablet report, sending...
I20260812 00:09:05.936928 10061 ts_manager.cc:194] Registered new tserver with Master: 603b5106201f4f81b40e622785fb938c (127.19.59.65:42195)
I20260812 00:09:05.937565 10061 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.59.65:47049
W20260812 00:09:06.010004 10276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:06.010202 10276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:06.010224 10276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:06.011333 10276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:06.011373 10276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:06.011425 10276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.66
I20260812 00:09:06.012812 10276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.59.66
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.66
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:06.013063 10276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:06.013379 10276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:06.018316 10282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:06.018316 10281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:06.018344 10284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:06.018584 10276 server_base.cc:1034] running on GCE node
I20260812 00:09:06.018832 10276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:06.019100 10276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:06.020241 10276 hybrid_clock.cc:648] HybridClock initialized: now 1786493346020227 us; error 29 us; skew 500 ppm
I20260812 00:09:06.021453 10276 webserver.cc:460] Webserver started at http://127.19.59.66:43651/ using document root <none> and password file <none>
I20260812 00:09:06.021700 10276 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:06.021745 10276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:06.021945 10276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:06.022965 10276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/data/instance:
uuid: "c37162c790e049ef8675223c3b5eb7d0"
format_stamp: "Formatted at 2026-08-12 00:09:06 on dist-test-slave-6nmv"
server_key: "75b7113a86420844b4bff42c2d3162d3"
server_key_iv: "c03e32892d17fba3a7d534b2b2ebef4c"
server_key_version: "encryptionkey@0"
I20260812 00:09:06.023343 10276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance:
uuid: "c37162c790e049ef8675223c3b5eb7d0"
format_stamp: "Formatted at 2026-08-12 00:09:06 on dist-test-slave-6nmv"
server_key: "75b7113a86420844b4bff42c2d3162d3"
server_key_iv: "c03e32892d17fba3a7d534b2b2ebef4c"
server_key_version: "encryptionkey@0"
I20260812 00:09:06.024610 10276 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:09:06.025290 10292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:06.025468 10276 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:06.025569 10276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/wal
uuid: "c37162c790e049ef8675223c3b5eb7d0"
format_stamp: "Formatted at 2026-08-12 00:09:06 on dist-test-slave-6nmv"
server_key: "75b7113a86420844b4bff42c2d3162d3"
server_key_iv: "c03e32892d17fba3a7d534b2b2ebef4c"
server_key_version: "encryptionkey@0"
I20260812 00:09:06.025642 10276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:06.033463 10276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:06.033725 10276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:06.033890 10276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:06.034106 10276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:09:06.034442 10276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:09:06.034497 10276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:06.034538 10276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:09:06.034564 10276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:06.040307 10276 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.66:34227
I20260812 00:09:06.040351 10425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.66:34227 every 8 connection(s)
I20260812 00:09:06.040652 10276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/data/info.pb
I20260812 00:09:06.045504 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.041307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:60001 (local address 127.19.59.126:35217)
0812 00:09:06.041372 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:06.041375 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:06.041600 (+ 225us) server_negotiation.cc:407] Connection header received
0812 00:09:06.042111 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:06.042113 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:06.042122 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:06.042172 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:06.042797 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.043304 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.044235 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.044441 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.044497 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.045280 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:06.045281 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:06.045281 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:06.045285 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:06.045297 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:06.045300 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:06.045337 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:06.045426 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 00:09:06.045447 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:09:06.045706 10429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.041291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:35217 (local address 127.19.59.66:60001)
0812 00:09:06.041492 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:06.041521 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:06.042026 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:06.042233 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:06.042236 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:06.042243 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:06.042715 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:06.042719 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.043383 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.043384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:06.044147 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:06.044149 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.044517 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.044518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:06.044625 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.045159 (+ 534us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:09:06.045159 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:06.045185 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:09:06.045206 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:06.045354 (+ 148us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:06.045356 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:06.045359 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:09:06.045416 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 00:09:06.045491 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":110,"threads_started":1}
I20260812 00:09:06.046243 10426 heartbeater.cc:347] Connected to a master server at 127.19.59.126:35217
I20260812 00:09:06.046343 10426 heartbeater.cc:464] Registering TS with master...
I20260812 00:09:06.046516 10426 heartbeater.cc:511] Master 127.19.59.126:35217 requested a full tablet report, sending...
I20260812 00:09:06.046945 10061 ts_manager.cc:194] Registered new tserver with Master: c37162c790e049ef8675223c3b5eb7d0 (127.19.59.66:34227)
I20260812 00:09:06.047355 10061 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.59.66:60001
I20260812 00:09:06.047902 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 10276
I20260812 00:09:06.048010 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/wal/instance
I20260812 00:09:06.048223 19693 external_mini_cluster.cc:1428] Setting key 5f9d3b10ac68226e9e95de06071b48f9
I20260812 00:09:06.049036 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.59.67:0
--local_ip_for_outbound_sockets=127.19.59.67
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35217
--builtin_ntp_servers=127.19.59.84:37153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:09:06.127141 10430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:06.127326 10430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:06.127345 10430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:06.128429 10430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:06.128466 10430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:06.128492 10430 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.59.67
I20260812 00:09:06.129737 10430 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:37153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.59.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.59.67
--webserver_port=0
--tserver_master_addrs=127.19.59.126:35217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.59.67
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:06.129937 10430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:06.130151 10430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:06.134756 10439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:06.134764 10436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:06.134943 10430 server_base.cc:1034] running on GCE node
W20260812 00:09:06.134781 10437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:06.135200 10430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:06.135401 10430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:06.136533 10430 hybrid_clock.cc:648] HybridClock initialized: now 1786493346136517 us; error 39 us; skew 500 ppm
I20260812 00:09:06.137683 10430 webserver.cc:460] Webserver started at http://127.19.59.67:46455/ using document root <none> and password file <none>
I20260812 00:09:06.137928 10430 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:06.137974 10430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:06.138083 10430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:06.138991 10430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/data/instance:
uuid: "ffa161a8bbab4015ad6e95dda6f72f58"
format_stamp: "Formatted at 2026-08-12 00:09:06 on dist-test-slave-6nmv"
server_key: "bc73c10c655499da24a0e9c5e8119c4e"
server_key_iv: "4093a727722563445fd04f4d479b72e0"
server_key_version: "encryptionkey@0"
I20260812 00:09:06.139267 10430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance:
uuid: "ffa161a8bbab4015ad6e95dda6f72f58"
format_stamp: "Formatted at 2026-08-12 00:09:06 on dist-test-slave-6nmv"
server_key: "bc73c10c655499da24a0e9c5e8119c4e"
server_key_iv: "4093a727722563445fd04f4d479b72e0"
server_key_version: "encryptionkey@0"
I20260812 00:09:06.140406 10430 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:09:06.141033 10446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:06.141178 10430 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:09:06.141250 10430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/wal
uuid: "ffa161a8bbab4015ad6e95dda6f72f58"
format_stamp: "Formatted at 2026-08-12 00:09:06 on dist-test-slave-6nmv"
server_key: "bc73c10c655499da24a0e9c5e8119c4e"
server_key_iv: "4093a727722563445fd04f4d479b72e0"
server_key_version: "encryptionkey@0"
I20260812 00:09:06.141320 10430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:06.156786 10430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:06.157086 10430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:06.157236 10430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:06.157467 10430 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:09:06.157879 10430 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:09:06.157920 10430 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:06.157943 10430 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:09:06.157984 10430 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:06.163703 10430 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.67:36917
I20260812 00:09:06.163781 10576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.67:36917 every 8 connection(s)
I20260812 00:09:06.164112 10430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/data/info.pb
I20260812 00:09:06.168900 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.164880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.67:59413 (local address 127.19.59.126:35217)
0812 00:09:06.164949 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:06.164952 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:06.165183 (+ 231us) server_negotiation.cc:407] Connection header received
0812 00:09:06.165630 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:06.165631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:06.165641 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:06.165693 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:06.166308 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.166782 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.167680 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.167856 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.167902 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.168705 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:06.168706 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:06.168706 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:06.168710 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:06.168720 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:06.168723 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:06.168759 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:06.168822 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 00:09:06.168842 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:09:06.169214 10579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.164870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:35217 (local address 127.19.59.67:59413)
0812 00:09:06.165068 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:06.165098 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:06.165550 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:06.165741 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:06.165744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:06.165752 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:06.166237 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:06.166241 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.166859 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.166860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:06.167609 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:06.167611 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.167924 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.167925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:06.168025 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.168587 (+ 562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:09:06.168588 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:06.168614 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:09:06.168635 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:06.168761 (+ 126us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:06.168763 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:06.168765 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:09:06.168809 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:09:06.168883 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":101,"threads_started":1}
I20260812 00:09:06.169690 10577 heartbeater.cc:347] Connected to a master server at 127.19.59.126:35217
I20260812 00:09:06.169793 10577 heartbeater.cc:464] Registering TS with master...
I20260812 00:09:06.169989 10577 heartbeater.cc:511] Master 127.19.59.126:35217 requested a full tablet report, sending...
I20260812 00:09:06.170375 10061 ts_manager.cc:194] Registered new tserver with Master: ffa161a8bbab4015ad6e95dda6f72f58 (127.19.59.67:36917)
I20260812 00:09:06.170742 10061 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.59.67:59413
I20260812 00:09:06.174221 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 10430
I20260812 00:09:06.174342 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/wal/instance
I20260812 00:09:06.174561 19693 external_mini_cluster.cc:1428] Setting key 9659eb264f7eb3f00e8ac3efc23bb664
I20260812 00:09:06.175331 19693 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:09:06.179097 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.176665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52782 (local address 127.19.59.126:35217)
0812 00:09:06.176743 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:06.176745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:06.176796 (+ 51us) server_negotiation.cc:407] Connection header received
0812 00:09:06.176842 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:06.176842 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:06.176851 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:06.176892 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:06.177042 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.177429 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.178136 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.178287 (+ 151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.178333 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.178914 (+ 581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:06.178914 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:06.178915 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:06.178918 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:06.178927 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:06.178929 (+ 2us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:06.178959 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:06.179005 (+ 46us) server_negotiation.cc:299] Negotiation successful
0812 00:09:06.179020 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 00:09:06.180605 10061 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52782:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:09:06.182026 10061 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:09:06.187913 10591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.184087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38660 (local address 127.19.59.65:42195)
0812 00:09:06.184459 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:06.184480 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:06.184493 (+ 13us) server_negotiation.cc:407] Connection header received
0812 00:09:06.184524 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:06.184525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:06.184536 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:06.184637 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:06.184762 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.185885 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.187076 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.187517 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.187608 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.187710 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:06.187803 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 00:09:06.187840 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":101,"threads_started":1}
I20260812 00:09:06.187909 10589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.183908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:42195 (local address 127.0.0.1:38660)
0812 00:09:06.184086 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:06.184125 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:06.184187 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:06.184633 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:06.184634 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:06.184636 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:06.184682 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:06.184684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.185967 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.185968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:06.186991 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:06.186993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.187611 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.187612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:06.187702 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.187715 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 00:09:06.187791 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 00:09:06.187838 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":87,"threads_started":1}
I20260812 00:09:06.188311 10594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.184274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53178 (local address 127.19.59.67:36917)
0812 00:09:06.184439 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:06.184442 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:06.184449 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:09:06.184486 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:06.184488 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:06.184498 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:06.184581 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:06.184728 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.185561 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.187058 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.187719 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.187807 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.187885 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:06.188176 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 00:09:06.188227 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":79,"threads_started":1}
I20260812 00:09:06.188313 10590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.183904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:36917 (local address 127.0.0.1:53178)
0812 00:09:06.184087 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:06.184125 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:06.184187 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:06.184595 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:06.184597 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:06.184599 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:06.184652 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:06.184654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.185644 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.185645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:06.186965 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:06.186968 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.188007 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.188008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:06.188092 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.188096 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:09:06.188159 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:09:06.188214 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":28,"thread_start_us":65,"threads_started":1}
I20260812 00:09:06.188468 10593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.184179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50818 (local address 127.19.59.66:34227)
0812 00:09:06.184386 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:06.184390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:06.184862 (+ 472us) server_negotiation.cc:407] Connection header received
0812 00:09:06.184905 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:06.184907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:06.184921 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:06.184995 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:06.185117 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.186141 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.187171 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.187828 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.187880 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.187944 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:06.188352 (+ 408us) server_negotiation.cc:299] Negotiation successful
0812 00:09:06.188391 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":83,"threads_started":1}
I20260812 00:09:06.188616 10588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.183924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.66:34227 (local address 127.0.0.1:50818)
0812 00:09:06.184724 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:06.184735 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:06.184781 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:06.184994 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:06.184995 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:06.184997 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:06.185052 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:06.185053 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.186220 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.186221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:06.187084 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:06.187086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.187996 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.187998 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:06.188109 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.188116 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:09:06.188199 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 00:09:06.188245 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"mutex_wait_us":1,"thread_start_us":110,"threads_started":1}
I20260812 00:09:06.188899 10194 tablet_service.cc:1467] Processing CreateTablet for tablet cfe25b3591a84c39a6142be91aa22d52 (DEFAULT_TABLE table=test-table [id=af6da8ec278d4ae1a28a23e6798a990f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:09:06.189276 10194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfe25b3591a84c39a6142be91aa22d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:06.189224 10350 tablet_service.cc:1467] Processing CreateTablet for tablet cfe25b3591a84c39a6142be91aa22d52 (DEFAULT_TABLE table=test-table [id=af6da8ec278d4ae1a28a23e6798a990f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:09:06.189558 10350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfe25b3591a84c39a6142be91aa22d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:06.190452 10499 tablet_service.cc:1467] Processing CreateTablet for tablet cfe25b3591a84c39a6142be91aa22d52 (DEFAULT_TABLE table=test-table [id=af6da8ec278d4ae1a28a23e6798a990f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:09:06.190734 10499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfe25b3591a84c39a6142be91aa22d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:06.192305 10595 tablet_bootstrap.cc:492] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0: Bootstrap starting.
I20260812 00:09:06.192552 10596 tablet_bootstrap.cc:492] T cfe25b3591a84c39a6142be91aa22d52 P 603b5106201f4f81b40e622785fb938c: Bootstrap starting.
I20260812 00:09:06.192925 10595 tablet_bootstrap.cc:654] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:06.193209 10596 tablet_bootstrap.cc:654] T cfe25b3591a84c39a6142be91aa22d52 P 603b5106201f4f81b40e622785fb938c: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:06.193239 10595 log.cc:824] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:06.193553 10596 log.cc:824] T cfe25b3591a84c39a6142be91aa22d52 P 603b5106201f4f81b40e622785fb938c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:06.193933 10601 tablet_bootstrap.cc:492] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58: Bootstrap starting.
I20260812 00:09:06.194121 10595 tablet_bootstrap.cc:492] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0: No bootstrap required, opened a new log
I20260812 00:09:06.194191 10595 ts_tablet_manager.cc:1397] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:09:06.194484 10596 tablet_bootstrap.cc:492] T cfe25b3591a84c39a6142be91aa22d52 P 603b5106201f4f81b40e622785fb938c: No bootstrap required, opened a new log
I20260812 00:09:06.194561 10596 ts_tablet_manager.cc:1397] T cfe25b3591a84c39a6142be91aa22d52 P 603b5106201f4f81b40e622785fb938c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:09:06.194593 10601 tablet_bootstrap.cc:654] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:06.194890 10601 log.cc:824] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:06.195887 10601 tablet_bootstrap.cc:492] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58: No bootstrap required, opened a new log
I20260812 00:09:06.195951 10601 ts_tablet_manager.cc:1397] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:09:06.196254 10595 raft_consensus.cc:348] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa161a8bbab4015ad6e95dda6f72f58" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36917 } } peers { permanent_uuid: "603b5106201f4f81b40e622785fb938c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42195 } } peers { permanent_uuid: "c37162c790e049ef8675223c3b5eb7d0" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 34227 } }
I20260812 00:09:06.196384 10595 raft_consensus.cc:374] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:06.196420 10595 raft_consensus.cc:729] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37162c790e049ef8675223c3b5eb7d0, State: Initialized, Role: FOLLOWER
I20260812 00:09:06.196519 10595 consensus_queue.cc:260] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa161a8bbab4015ad6e95dda6f72f58" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36917 } } peers { permanent_uuid: "603b5106201f4f81b40e622785fb938c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42195 } } peers { permanent_uuid: "c37162c790e049ef8675223c3b5eb7d0" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 34227 } }
I20260812 00:09:06.196746 10595 ts_tablet_manager.cc:1428] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:09:06.196765 10596 raft_consensus.cc:348] T cfe25b3591a84c39a6142be91aa22d52 P 603b5106201f4f81b40e622785fb938c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa161a8bbab4015ad6e95dda6f72f58" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36917 } } peers { permanent_uuid: "603b5106201f4f81b40e622785fb938c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42195 } } peers { permanent_uuid: "c37162c790e049ef8675223c3b5eb7d0" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 34227 } }
I20260812 00:09:06.196877 10426 heartbeater.cc:503] Master 127.19.59.126:35217 was elected leader, sending a full tablet report...
I20260812 00:09:06.196906 10596 raft_consensus.cc:374] T cfe25b3591a84c39a6142be91aa22d52 P 603b5106201f4f81b40e622785fb938c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:06.196942 10596 raft_consensus.cc:729] T cfe25b3591a84c39a6142be91aa22d52 P 603b5106201f4f81b40e622785fb938c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 603b5106201f4f81b40e622785fb938c, State: Initialized, Role: FOLLOWER
I20260812 00:09:06.197048 10596 consensus_queue.cc:260] T cfe25b3591a84c39a6142be91aa22d52 P 603b5106201f4f81b40e622785fb938c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa161a8bbab4015ad6e95dda6f72f58" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36917 } } peers { permanent_uuid: "603b5106201f4f81b40e622785fb938c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42195 } } peers { permanent_uuid: "c37162c790e049ef8675223c3b5eb7d0" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 34227 } }
I20260812 00:09:06.197284 10596 ts_tablet_manager.cc:1428] T cfe25b3591a84c39a6142be91aa22d52 P 603b5106201f4f81b40e622785fb938c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:09:06.197402 10272 heartbeater.cc:503] Master 127.19.59.126:35217 was elected leader, sending a full tablet report...
I20260812 00:09:06.198338 10601 raft_consensus.cc:348] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa161a8bbab4015ad6e95dda6f72f58" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36917 } } peers { permanent_uuid: "603b5106201f4f81b40e622785fb938c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42195 } } peers { permanent_uuid: "c37162c790e049ef8675223c3b5eb7d0" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 34227 } }
I20260812 00:09:06.198439 10601 raft_consensus.cc:374] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:06.198458 10601 raft_consensus.cc:729] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffa161a8bbab4015ad6e95dda6f72f58, State: Initialized, Role: FOLLOWER
I20260812 00:09:06.198585 10601 consensus_queue.cc:260] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa161a8bbab4015ad6e95dda6f72f58" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36917 } } peers { permanent_uuid: "603b5106201f4f81b40e622785fb938c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42195 } } peers { permanent_uuid: "c37162c790e049ef8675223c3b5eb7d0" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 34227 } }
I20260812 00:09:06.198799 10601 ts_tablet_manager.cc:1428] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:09:06.198860 10577 heartbeater.cc:503] Master 127.19.59.126:35217 was elected leader, sending a full tablet report...
W20260812 00:09:06.291168 10427 tablet.cc:2369] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:09:06.346215 10603 raft_consensus.cc:482] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:09:06.346323 10603 raft_consensus.cc:504] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa161a8bbab4015ad6e95dda6f72f58" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36917 } } peers { permanent_uuid: "603b5106201f4f81b40e622785fb938c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42195 } } peers { permanent_uuid: "c37162c790e049ef8675223c3b5eb7d0" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 34227 } }
I20260812 00:09:06.346771 10603 leader_election.cc:288] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffa161a8bbab4015ad6e95dda6f72f58 (127.19.59.67:36917), 603b5106201f4f81b40e622785fb938c (127.19.59.65:42195)
I20260812 00:09:06.350308 10594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.347021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:33939 (local address 127.19.59.67:36917)
0812 00:09:06.347095 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:06.347097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:06.347109 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:09:06.347156 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:06.347157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:06.347166 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:06.347233 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:06.347414 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.348150 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.349482 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.349979 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.350049 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.350058 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:06.350212 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 00:09:06.350247 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 00:09:06.350308 10591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.347079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.59.66:42569 (local address 127.19.59.65:42195)
0812 00:09:06.347138 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:06.347140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:06.347192 (+ 52us) server_negotiation.cc:407] Connection header received
0812 00:09:06.347269 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:06.347269 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:06.347280 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:06.347329 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:09:06.347500 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.348176 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.349487 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.349980 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.350054 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.350060 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:06.350212 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 00:09:06.350247 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:09:06.350317 10429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.346932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.67:36917 (local address 127.19.59.66:33939)
0812 00:09:06.346988 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:06.346999 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:06.347059 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:06.347251 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:06.347252 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:06.347254 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:06.347354 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:06.347357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.348241 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.348242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:06.349398 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:06.349400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.350056 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.350057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:06.350137 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.350142 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:09:06.350193 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:09:06.350236 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":74}
I20260812 00:09:06.350327 10606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.346945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:42195 (local address 127.19.59.66:42569)
0812 00:09:06.347135 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:06.347143 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:06.347200 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:06.347368 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:06.347368 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:06.347370 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:09:06.347430 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:06.347431 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.348241 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.348242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:06.349398 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:06.349400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.350056 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.350057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:06.350137 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.350142 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:09:06.350193 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:09:06.350234 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":58,"thread_start_us":129,"threads_started":1}
I20260812 00:09:06.350631 10521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe25b3591a84c39a6142be91aa22d52" candidate_uuid: "c37162c790e049ef8675223c3b5eb7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffa161a8bbab4015ad6e95dda6f72f58" is_pre_election: true
I20260812 00:09:06.350800 10521 raft_consensus.cc:2454] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c37162c790e049ef8675223c3b5eb7d0 in term 0.
I20260812 00:09:06.350839 10219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe25b3591a84c39a6142be91aa22d52" candidate_uuid: "c37162c790e049ef8675223c3b5eb7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "603b5106201f4f81b40e622785fb938c" is_pre_election: true
I20260812 00:09:06.350978 10219 raft_consensus.cc:2454] T cfe25b3591a84c39a6142be91aa22d52 P 603b5106201f4f81b40e622785fb938c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c37162c790e049ef8675223c3b5eb7d0 in term 0.
I20260812 00:09:06.351027 10295 leader_election.cc:302] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c37162c790e049ef8675223c3b5eb7d0, ffa161a8bbab4015ad6e95dda6f72f58; no voters:
I20260812 00:09:06.351135 10603 raft_consensus.cc:2781] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:09:06.351189 10603 raft_consensus.cc:482] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:09:06.351212 10603 raft_consensus.cc:3037] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:06.351929 10603 raft_consensus.cc:504] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa161a8bbab4015ad6e95dda6f72f58" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36917 } } peers { permanent_uuid: "603b5106201f4f81b40e622785fb938c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42195 } } peers { permanent_uuid: "c37162c790e049ef8675223c3b5eb7d0" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 34227 } }
I20260812 00:09:06.352090 10603 leader_election.cc:288] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [CANDIDATE]: Term 1 election: Requested vote from peers ffa161a8bbab4015ad6e95dda6f72f58 (127.19.59.67:36917), 603b5106201f4f81b40e622785fb938c (127.19.59.65:42195)
I20260812 00:09:06.352221 10521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe25b3591a84c39a6142be91aa22d52" candidate_uuid: "c37162c790e049ef8675223c3b5eb7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffa161a8bbab4015ad6e95dda6f72f58"
I20260812 00:09:06.352268 10219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe25b3591a84c39a6142be91aa22d52" candidate_uuid: "c37162c790e049ef8675223c3b5eb7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "603b5106201f4f81b40e622785fb938c"
I20260812 00:09:06.352306 10521 raft_consensus.cc:3037] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:06.352335 10219 raft_consensus.cc:3037] T cfe25b3591a84c39a6142be91aa22d52 P 603b5106201f4f81b40e622785fb938c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:06.353252 10521 raft_consensus.cc:2454] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37162c790e049ef8675223c3b5eb7d0 in term 1.
I20260812 00:09:06.353252 10219 raft_consensus.cc:2454] T cfe25b3591a84c39a6142be91aa22d52 P 603b5106201f4f81b40e622785fb938c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37162c790e049ef8675223c3b5eb7d0 in term 1.
I20260812 00:09:06.353430 10297 leader_election.cc:302] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 603b5106201f4f81b40e622785fb938c, c37162c790e049ef8675223c3b5eb7d0; no voters:
I20260812 00:09:06.353523 10603 raft_consensus.cc:2781] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:06.353667 10603 raft_consensus.cc:686] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [term 1 LEADER]: Becoming Leader. State: Replica: c37162c790e049ef8675223c3b5eb7d0, State: Running, Role: LEADER
I20260812 00:09:06.353895 10603 consensus_queue.cc:237] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa161a8bbab4015ad6e95dda6f72f58" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36917 } } peers { permanent_uuid: "603b5106201f4f81b40e622785fb938c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42195 } } peers { permanent_uuid: "c37162c790e049ef8675223c3b5eb7d0" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 34227 } }
I20260812 00:09:06.354773 10060 catalog_manager.cc:5495] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c37162c790e049ef8675223c3b5eb7d0 (127.19.59.66). New cstate: current_term: 1 leader_uuid: "c37162c790e049ef8675223c3b5eb7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa161a8bbab4015ad6e95dda6f72f58" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "603b5106201f4f81b40e622785fb938c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37162c790e049ef8675223c3b5eb7d0" member_type: VOTER last_known_addr { host: "127.19.59.66" port: 34227 } health_report { overall_health: HEALTHY } } }
I20260812 00:09:06.367142 10593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.364884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50822 (local address 127.19.59.66:34227)
0812 00:09:06.364939 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:06.364941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:06.364948 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:09:06.364992 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:06.364993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:06.365008 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:06.365086 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:09:06.365214 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.365624 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.366387 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:06.366568 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:06.366637 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:06.366816 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:09:06.366922 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:09:06.367014 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:06.367038 (+ 24us) server_negotiation.cc:299] Negotiation successful
0812 00:09:06.367060 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:09:06.368717 10521 raft_consensus.cc:1261] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58 [term 1 FOLLOWER]: Refusing update from remote peer c37162c790e049ef8675223c3b5eb7d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:09:06.368717 10219 raft_consensus.cc:1261] T cfe25b3591a84c39a6142be91aa22d52 P 603b5106201f4f81b40e622785fb938c [term 1 FOLLOWER]: Refusing update from remote peer c37162c790e049ef8675223c3b5eb7d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:09:06.368999 10607 consensus_queue.cc:1035] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "603b5106201f4f81b40e622785fb938c" member_type: VOTER last_known_addr { host: "127.19.59.65" port: 42195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:09:06.369117 10603 consensus_queue.cc:1035] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffa161a8bbab4015ad6e95dda6f72f58" member_type: VOTER last_known_addr { host: "127.19.59.67" port: 36917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:09:06.371652 10611 mvcc.cc:205] Tried to move back new op lower bound from 7317476746723762176 to 7317476746666176512. Current Snapshot: MvccSnapshot[applied={T|T < 7317476746723762176}]
I20260812 00:09:06.373499 10060 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52782:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:09:06.373586 10060 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52782:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:09:06.374363 10060 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 72c39c4e37a64901951518e001c87eff: Sending DeleteTablet for 3 replicas of tablet cfe25b3591a84c39a6142be91aa22d52
I20260812 00:09:06.374643 10499 tablet_service.cc:1514] Processing DeleteTablet for tablet cfe25b3591a84c39a6142be91aa22d52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:06 UTC) from {username='slave'} at 127.0.0.1:53178
I20260812 00:09:06.374862 10619 tablet_replica.cc:330] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58: stopping tablet replica
I20260812 00:09:06.374898 10498 tablet_service.cc:1514] Processing DeleteTablet for tablet cfe25b3591a84c39a6142be91aa22d52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:06 UTC) from {username='slave'} at 127.0.0.1:53178
I20260812 00:09:06.374958 10619 raft_consensus.cc:2229] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:09:06.374981 10350 tablet_service.cc:1514] Processing DeleteTablet for tablet cfe25b3591a84c39a6142be91aa22d52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:06 UTC) from {username='slave'} at 127.0.0.1:50818
I20260812 00:09:06.375070 10619 raft_consensus.cc:2258] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:09:06.375273 10620 tablet_replica.cc:330] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0: stopping tablet replica
I20260812 00:09:06.375320 10194 tablet_service.cc:1514] Processing DeleteTablet for tablet cfe25b3591a84c39a6142be91aa22d52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:09:06 UTC) from {username='slave'} at 127.0.0.1:38660
I20260812 00:09:06.375483 10620 raft_consensus.cc:2229] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:09:06.375694 10620 raft_consensus.cc:2258] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:09:06.375748 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 10127
I20260812 00:09:06.376223 10620 ts_tablet_manager.cc:1905] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:09:06.377902 10620 ts_tablet_manager.cc:1918] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:09:06.378057 10620 log.cc:1196] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-1/wal/wals/cfe25b3591a84c39a6142be91aa22d52
I20260812 00:09:06.378387 10620 ts_tablet_manager.cc:1939] T cfe25b3591a84c39a6142be91aa22d52 P c37162c790e049ef8675223c3b5eb7d0: Deleting consensus metadata
I20260812 00:09:06.378821 10043 catalog_manager.cc:4841] TS c37162c790e049ef8675223c3b5eb7d0 (127.19.59.66:34227): tablet cfe25b3591a84c39a6142be91aa22d52 (table test-table [id=af6da8ec278d4ae1a28a23e6798a990f]) successfully deleted
I20260812 00:09:06.379859 10619 ts_tablet_manager.cc:1905] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:09:06.381781 10619 ts_tablet_manager.cc:1918] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:09:06.381870 10619 log.cc:1196] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58: Deleting WAL directory at /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786493109864389-19693-0/minicluster-data/ts-2/wal/wals/cfe25b3591a84c39a6142be91aa22d52
I20260812 00:09:06.382118 10619 ts_tablet_manager.cc:1939] T cfe25b3591a84c39a6142be91aa22d52 P ffa161a8bbab4015ad6e95dda6f72f58: Deleting consensus metadata
I20260812 00:09:06.382505 10042 catalog_manager.cc:4841] TS ffa161a8bbab4015ad6e95dda6f72f58 (127.19.59.67:36917): tablet cfe25b3591a84c39a6142be91aa22d52 (table test-table [id=af6da8ec278d4ae1a28a23e6798a990f]) successfully deleted
W20260812 00:09:06.382639 10042 catalog_manager.cc:4808] TS ffa161a8bbab4015ad6e95dda6f72f58 (127.19.59.67:36917): delete failed for tablet cfe25b3591a84c39a6142be91aa22d52 because the tablet was not found. No further retry: Not found: Tablet not found: cfe25b3591a84c39a6142be91aa22d52
W20260812 00:09:06.384810 10044 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.59.65:42195 (error 108)
I20260812 00:09:06.385030 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 10276
I20260812 00:09:06.385867 10588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:06.385200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.65:42195 (local address 127.0.0.1:38676)
0812 00:09:06.385785 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:06.385840 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.65:42195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":567}
W20260812 00:09:06.386168 10044 catalog_manager.cc:4584] TS 603b5106201f4f81b40e622785fb938c (127.19.59.65:42195): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cfe25b3591a84c39a6142be91aa22d52: Network error: Client connection negotiation failed: client connection to 127.19.59.65:42195: connect: Connection refused (error 111)
I20260812 00:09:06.392768 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 10430
I20260812 00:09:06.398528 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 10025
2026-08-12T00:09:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (771 ms)
[----------] 6 tests from EncryptionPolicyTest (8377 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:06 dist-test-slave-6nmv krb5kdc[10626](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:06 dist-test-slave-6nmv krb5kdc[10626](info): set up 2 sockets
Aug 12 00:09:06 dist-test-slave-6nmv krb5kdc[10626](info): commencing operation
krb5kdc: starting...
W20260812 00:09:07.460183 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:07 dist-test-slave-6nmv krb5kdc[10626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493347, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:09:07.565946 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46583
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:07.641680 10640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:07.641855 10640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:07.641881 10640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:07.642781 10640 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:07.642810 10640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:07.642823 10640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:07.642834 10640 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:07.642844 10640 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:07.644186 10640 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46583
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:07.644358 10640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:07.644522 10640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:07.648669 10648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:07.648667 10646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:07.648684 10645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:07.648854 10640 server_base.cc:1034] running on GCE node
I20260812 00:09:07.649093 10640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:07.649370 10640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:07.650535 10640 hybrid_clock.cc:648] HybridClock initialized: now 1786493347650522 us; error 25 us; skew 500 ppm
Aug 12 00:09:07 dist-test-slave-6nmv krb5kdc[10626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493347, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:07.652786 10640 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:09:07.653190 10640 webserver.cc:460] Webserver started at http://127.0.0.1:42699/ using document root <none> and password file <none>
I20260812 00:09:07.653429 10640 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:07.653498 10640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:07.653642 10640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:07.654960 10640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "aec1a470d090494182f6e8f45773fc4d"
format_stamp: "Formatted at 2026-08-12 00:09:07 on dist-test-slave-6nmv"
server_key: "e0efe32134be9fd6f62a90da7841e460"
server_key_iv: "d94bda16bb98c6c66735be3806ff6ab7"
server_key_version: "encryptionkey@0"
I20260812 00:09:07.655315 10640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "aec1a470d090494182f6e8f45773fc4d"
format_stamp: "Formatted at 2026-08-12 00:09:07 on dist-test-slave-6nmv"
server_key: "e0efe32134be9fd6f62a90da7841e460"
server_key_iv: "d94bda16bb98c6c66735be3806ff6ab7"
server_key_version: "encryptionkey@0"
I20260812 00:09:07.656502 10640 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:09:07.657256 10656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:07.657437 10640 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:09:07.657523 10640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "aec1a470d090494182f6e8f45773fc4d"
format_stamp: "Formatted at 2026-08-12 00:09:07 on dist-test-slave-6nmv"
server_key: "e0efe32134be9fd6f62a90da7841e460"
server_key_iv: "d94bda16bb98c6c66735be3806ff6ab7"
server_key_version: "encryptionkey@0"
I20260812 00:09:07.657598 10640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:07.671096 10640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:07.673188 10640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:07.673362 10640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:07.677106 10640 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46583
I20260812 00:09:07.677137 10718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46583 every 8 connection(s)
I20260812 00:09:07.677451 10640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:07.678176 10719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:07.679976 10719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d: Bootstrap starting.
I20260812 00:09:07.680195 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 10640
I20260812 00:09:07.680310 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:07.680488 19693 external_mini_cluster.cc:1428] Setting key cac5c90b1e94b5fcdc00baf0526bce4a
I20260812 00:09:07.680629 10719 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:07.680955 10719 log.cc:824] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:07.681595 10719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d: No bootstrap required, opened a new log
I20260812 00:09:07.683663 10719 raft_consensus.cc:348] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec1a470d090494182f6e8f45773fc4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46583 } }
I20260812 00:09:07.683823 10719 raft_consensus.cc:374] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:07.683858 10719 raft_consensus.cc:729] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec1a470d090494182f6e8f45773fc4d, State: Initialized, Role: FOLLOWER
I20260812 00:09:07.683977 10719 consensus_queue.cc:260] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec1a470d090494182f6e8f45773fc4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46583 } }
I20260812 00:09:07.684046 10719 raft_consensus.cc:388] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:07.684073 10719 raft_consensus.cc:482] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:07.684116 10719 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:07.684811 10719 raft_consensus.cc:504] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec1a470d090494182f6e8f45773fc4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46583 } }
I20260812 00:09:07.684895 10719 leader_election.cc:302] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aec1a470d090494182f6e8f45773fc4d; no voters:
I20260812 00:09:07.685091 10719 leader_election.cc:288] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:07.685112 10725 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:07.685230 10725 raft_consensus.cc:686] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [term 1 LEADER]: Becoming Leader. State: Replica: aec1a470d090494182f6e8f45773fc4d, State: Running, Role: LEADER
I20260812 00:09:07.685307 10725 consensus_queue.cc:237] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec1a470d090494182f6e8f45773fc4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46583 } }
I20260812 00:09:07.685348 10719 sys_catalog.cc:564] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:07.685591 10725 sys_catalog.cc:455] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader aec1a470d090494182f6e8f45773fc4d. Latest consensus state: current_term: 1 leader_uuid: "aec1a470d090494182f6e8f45773fc4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec1a470d090494182f6e8f45773fc4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46583 } } }
I20260812 00:09:07.685667 10725 sys_catalog.cc:458] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:07.685601 10726 sys_catalog.cc:455] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aec1a470d090494182f6e8f45773fc4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec1a470d090494182f6e8f45773fc4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46583 } } }
I20260812 00:09:07.685710 10726 sys_catalog.cc:458] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:07.685928 10731 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:07.686388 10731 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 00:09:07 dist-test-slave-6nmv krb5kdc[10626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493347, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:09:07.688138 10731 catalog_manager.cc:1347] Generated new cluster ID: 2b7cf2c974f4483398416890ce985a32
I20260812 00:09:07.688185 10731 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:07.691361 10723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:07.680965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39997 (local address 127.0.0.1:46583)
0812 00:09:07.681123 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:07.681148 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:07.681183 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:09:07.681627 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:07.681633 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:07.681699 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:07.681856 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:07.682600 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:07.683383 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:07.684461 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:07.684902 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:07.685006 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:07.687800 (+ 2794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:07.687804 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:07.687804 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:07.687814 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:07.689607 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:07.690083 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:07.690086 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:07.690087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:07.690176 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:07.690357 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:07.690358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:07.690358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:07.690589 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:07.690717 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:07.691112 (+ 395us) server_negotiation.cc:299] Negotiation successful
0812 00:09:07.691205 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":62,"threads_started":1}
I20260812 00:09:07.692250 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:07.695355 10731 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:07.695772 10731 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:07.701865 10723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:07.694142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51777 (local address 127.0.0.1:46583)
0812 00:09:07.694175 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:07.694177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:07.695171 (+ 994us) server_negotiation.cc:407] Connection header received
0812 00:09:07.695233 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:07.695234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:07.695243 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:07.695296 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:07.695899 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:07.696500 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:07.697335 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:07.697623 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:07.697685 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:07.698910 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:07.698911 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:07.698912 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:07.698918 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:07.700553 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:07.701043 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:07.701044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:07.701044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:07.701108 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:07.701327 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:07.701328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:07.701328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:07.701437 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:07.701508 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:07.701687 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 00:09:07.701755 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:09:07.707000 10731 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aec1a470d090494182f6e8f45773fc4d: Generated new TSK 0
I20260812 00:09:07.707160 10731 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:07.710971 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 10640
W20260812 00:09:07.718214 10624 connection.cc:535] client connection to 127.0.0.1:46583 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46583): Connection reset by peer (error 104)
2026-08-12T00:09:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1312 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:07 dist-test-slave-6nmv krb5kdc[10757](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:07 dist-test-slave-6nmv krb5kdc[10757](info): set up 2 sockets
Aug 12 00:09:07 dist-test-slave-6nmv krb5kdc[10757](info): commencing operation
krb5kdc: starting...
W20260812 00:09:08.769191 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:08 dist-test-slave-6nmv krb5kdc[10757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:09:08.882647 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34789
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:08.960804 10770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:08.961046 10770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:08.961086 10770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:08.962177 10770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:08.962239 10770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:08.962266 10770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:08.962309 10770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:08.962340 10770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:08.963894 10770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34789
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:08.964160 10770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:08.964372 10770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:08.969354 10776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:08.969386 10770 server_base.cc:1034] running on GCE node
W20260812 00:09:08.969383 10775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:08.969506 10779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:08.969758 10770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:08.970083 10770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:08.971225 10770 hybrid_clock.cc:648] HybridClock initialized: now 1786493348971207 us; error 34 us; skew 500 ppm
Aug 12 00:09:08 dist-test-slave-6nmv krb5kdc[10757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493348, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:08.973649 10770 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:09:08.974161 10770 webserver.cc:460] Webserver started at http://127.0.0.1:44401/ using document root <none> and password file <none>
I20260812 00:09:08.974466 10770 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:08.974542 10770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:08.974681 10770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:08.975883 10770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "10814275cc404097b1e33cbc69bbfa5b"
format_stamp: "Formatted at 2026-08-12 00:09:08 on dist-test-slave-6nmv"
server_key: "f416579d3440e62cffa6135897db7796"
server_key_iv: "2512f5e4ce779ed5c42104b28934a8a4"
server_key_version: "encryptionkey@0"
I20260812 00:09:08.976233 10770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "10814275cc404097b1e33cbc69bbfa5b"
format_stamp: "Formatted at 2026-08-12 00:09:08 on dist-test-slave-6nmv"
server_key: "f416579d3440e62cffa6135897db7796"
server_key_iv: "2512f5e4ce779ed5c42104b28934a8a4"
server_key_version: "encryptionkey@0"
I20260812 00:09:08.977485 10770 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:09:08.978271 10787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:08.978443 10770 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:08.978520 10770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "10814275cc404097b1e33cbc69bbfa5b"
format_stamp: "Formatted at 2026-08-12 00:09:08 on dist-test-slave-6nmv"
server_key: "f416579d3440e62cffa6135897db7796"
server_key_iv: "2512f5e4ce779ed5c42104b28934a8a4"
server_key_version: "encryptionkey@0"
I20260812 00:09:08.978577 10770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:08.993634 10770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:08.995442 10770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:08.995546 10770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:08.999240 10770 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34789
I20260812 00:09:08.999315 10847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34789 every 8 connection(s)
I20260812 00:09:08.999644 10770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:09.000492 10848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:09.002735 10848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b: Bootstrap starting.
I20260812 00:09:09.003309 10848 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:09.003619 10848 log.cc:824] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:09.004302 10848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b: No bootstrap required, opened a new log
I20260812 00:09:09.005874 10848 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10814275cc404097b1e33cbc69bbfa5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34789 } }
I20260812 00:09:09.006033 10848 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:09.006081 10848 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10814275cc404097b1e33cbc69bbfa5b, State: Initialized, Role: FOLLOWER
I20260812 00:09:09.006248 10848 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10814275cc404097b1e33cbc69bbfa5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34789 } }
I20260812 00:09:09.006345 10848 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:09.006387 10848 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:09.006438 10848 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:09.006934 10848 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10814275cc404097b1e33cbc69bbfa5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34789 } }
I20260812 00:09:09.007066 10848 leader_election.cc:302] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10814275cc404097b1e33cbc69bbfa5b; no voters:
I20260812 00:09:09.007241 10848 leader_election.cc:288] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:09.007259 10852 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:09.007436 10852 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [term 1 LEADER]: Becoming Leader. State: Replica: 10814275cc404097b1e33cbc69bbfa5b, State: Running, Role: LEADER
I20260812 00:09:09.007547 10852 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10814275cc404097b1e33cbc69bbfa5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34789 } }
I20260812 00:09:09.007710 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 10770
I20260812 00:09:09.007817 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:09.007926 10854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10814275cc404097b1e33cbc69bbfa5b. Latest consensus state: current_term: 1 leader_uuid: "10814275cc404097b1e33cbc69bbfa5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10814275cc404097b1e33cbc69bbfa5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34789 } } }
I20260812 00:09:09.008010 10854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:09.008018 19693 external_mini_cluster.cc:1428] Setting key de3c7db71e6acc06d58c3972bdf15dbc
I20260812 00:09:09.007504 10848 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:09.008302 10853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10814275cc404097b1e33cbc69bbfa5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10814275cc404097b1e33cbc69bbfa5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34789 } } }
I20260812 00:09:09.008370 10853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:09.008344 10856 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:09.009132 10856 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:09.010625 10856 catalog_manager.cc:1347] Generated new cluster ID: 637b7ed7489c4c0f84e113dabf04ece2
I20260812 00:09:09.010684 10856 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:09.014180 10860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:09.008549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58725 (local address 127.0.0.1:34789)
0812 00:09:09.008744 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:09.008754 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:09.008788 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:09:09.008899 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:09.008905 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:09.008961 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:09.009140 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:09.009320 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:09.010760 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:09.012034 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:09.012672 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:09.012787 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:09.013480 (+ 693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:09.013484 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:09.013484 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:09.013688 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:09.013726 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:09.013741 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:09.013858 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:09.013934 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 00:09:09.013961 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":72,"threads_started":1}
I20260812 00:09:09.015082 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:09.019510 10860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:09.016405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47797 (local address 127.0.0.1:34789)
0812 00:09:09.016433 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:09.016435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:09.016548 (+ 113us) server_negotiation.cc:407] Connection header received
0812 00:09:09.016592 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:09.016593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:09.016603 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:09.016660 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:09.016767 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:09.017431 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:09.018324 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:09.018617 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:09.018693 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:09.019294 (+ 601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:09.019295 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:09.019295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:09.019299 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:09.019312 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:09.019315 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:09.019371 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:09.019434 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 00:09:09.019446 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260812 00:09:09.022994 10856 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:09.023422 10856 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:09.027052 10856 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10814275cc404097b1e33cbc69bbfa5b: Generated new TSK 0
I20260812 00:09:09.027215 10856 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:09.032925 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 10770
W20260812 00:09:09.041729 10753 connection.cc:535] client connection to 127.0.0.1:34789 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34789): Connection reset by peer (error 104)
2026-08-12T00:09:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1323 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:09 dist-test-slave-6nmv krb5kdc[10881](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:09 dist-test-slave-6nmv krb5kdc[10881](info): set up 2 sockets
Aug 12 00:09:09 dist-test-slave-6nmv krb5kdc[10881](info): commencing operation
krb5kdc: starting...
W20260812 00:09:10.093305 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:10 dist-test-slave-6nmv krb5kdc[10881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493350, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:09:10.208585 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36105
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36105
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:10.286494 10896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:10.286672 10896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:10.286693 10896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:10.287700 10896 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:10.287732 10896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:10.287745 10896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:10.287757 10896 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:10.287770 10896 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:10.289031 10896 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36105
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36105
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:10.289194 10896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:10.289340 10896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:10.293877 10908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:10.293879 10906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:10.293916 10905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:10.294063 10896 server_base.cc:1034] running on GCE node
I20260812 00:09:10.294296 10896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:10.294515 10896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:10.295657 10896 hybrid_clock.cc:648] HybridClock initialized: now 1786493350295630 us; error 34 us; skew 500 ppm
Aug 12 00:09:10 dist-test-slave-6nmv krb5kdc[10881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493350, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:10.302428 10896 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:09:10.302793 10896 webserver.cc:460] Webserver started at http://127.0.0.1:33465/ using document root <none> and password file <none>
I20260812 00:09:10.302965 10896 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:10.303001 10896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:10.303081 10896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:10.304018 10896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "aba7e82835bf463998795b00219b0ae6"
format_stamp: "Formatted at 2026-08-12 00:09:10 on dist-test-slave-6nmv"
server_key: "ad10097c1b108cfdb8b7814d436d97ff"
server_key_iv: "0cb886cd7cf2a1114aff6cbb65bf8c13"
server_key_version: "encryptionkey@0"
I20260812 00:09:10.304307 10896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "aba7e82835bf463998795b00219b0ae6"
format_stamp: "Formatted at 2026-08-12 00:09:10 on dist-test-slave-6nmv"
server_key: "ad10097c1b108cfdb8b7814d436d97ff"
server_key_iv: "0cb886cd7cf2a1114aff6cbb65bf8c13"
server_key_version: "encryptionkey@0"
I20260812 00:09:10.305495 10896 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:09:10.306185 10918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:10.306365 10896 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:10.306447 10896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "aba7e82835bf463998795b00219b0ae6"
format_stamp: "Formatted at 2026-08-12 00:09:10 on dist-test-slave-6nmv"
server_key: "ad10097c1b108cfdb8b7814d436d97ff"
server_key_iv: "0cb886cd7cf2a1114aff6cbb65bf8c13"
server_key_version: "encryptionkey@0"
I20260812 00:09:10.306496 10896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:10.309208 10896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:10.310868 10896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:10.310959 10896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:10.314736 10896 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36105
I20260812 00:09:10.314776 10976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36105 every 8 connection(s)
I20260812 00:09:10.315088 10896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:10.315922 10977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:10.317878 10977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6: Bootstrap starting.
I20260812 00:09:10.318398 10977 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:10.318663 10977 log.cc:824] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:10.319339 10977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6: No bootstrap required, opened a new log
I20260812 00:09:10.320811 10977 raft_consensus.cc:348] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aba7e82835bf463998795b00219b0ae6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36105 } }
I20260812 00:09:10.320958 10977 raft_consensus.cc:374] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:10.320998 10977 raft_consensus.cc:729] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba7e82835bf463998795b00219b0ae6, State: Initialized, Role: FOLLOWER
I20260812 00:09:10.321189 10977 consensus_queue.cc:260] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aba7e82835bf463998795b00219b0ae6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36105 } }
I20260812 00:09:10.321278 10977 raft_consensus.cc:388] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:10.321318 10977 raft_consensus.cc:482] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:10.321364 10977 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:10.321880 10977 raft_consensus.cc:504] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aba7e82835bf463998795b00219b0ae6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36105 } }
I20260812 00:09:10.322010 10977 leader_election.cc:302] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aba7e82835bf463998795b00219b0ae6; no voters:
I20260812 00:09:10.322160 10977 leader_election.cc:288] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:10.322180 10981 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:10.322337 10981 raft_consensus.cc:686] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [term 1 LEADER]: Becoming Leader. State: Replica: aba7e82835bf463998795b00219b0ae6, State: Running, Role: LEADER
I20260812 00:09:10.322386 10977 sys_catalog.cc:564] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:10.322419 10981 consensus_queue.cc:237] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aba7e82835bf463998795b00219b0ae6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36105 } }
I20260812 00:09:10.322841 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 10896
I20260812 00:09:10.322973 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:10.323045 10982 sys_catalog.cc:455] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aba7e82835bf463998795b00219b0ae6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aba7e82835bf463998795b00219b0ae6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36105 } } }
I20260812 00:09:10.323169 19693 external_mini_cluster.cc:1428] Setting key 873a2356313aa6d7929dab676947bdd5
I20260812 00:09:10.323201 10982 sys_catalog.cc:458] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:10.323361 10983 sys_catalog.cc:455] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aba7e82835bf463998795b00219b0ae6. Latest consensus state: current_term: 1 leader_uuid: "aba7e82835bf463998795b00219b0ae6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aba7e82835bf463998795b00219b0ae6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36105 } } }
I20260812 00:09:10.323446 10983 sys_catalog.cc:458] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:10.323431 10991 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:10.324218 10991 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:10.325660 10991 catalog_manager.cc:1347] Generated new cluster ID: edb704439c584fadaf29946dca946ac0
I20260812 00:09:10.325708 10991 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:10.326205 10999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:10.323834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54781 (local address 127.0.0.1:36105)
0812 00:09:10.324014 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:10.324023 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:10.324670 (+ 647us) server_negotiation.cc:407] Connection header received
0812 00:09:10.324897 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:10.324903 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:10.324930 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:10.325324 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:10.325756 (+ 432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:10.325759 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:10.325760 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:10.325763 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:10.325792 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:10.325804 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:10.325914 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:10.326009 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 00:09:10.326047 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":84,"threads_started":1}
I20260812 00:09:10.327054 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:10.330863 10999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:10.328398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39203 (local address 127.0.0.1:36105)
0812 00:09:10.328427 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:10.328428 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:10.330008 (+ 1580us) server_negotiation.cc:407] Connection header received
0812 00:09:10.330034 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:10.330035 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:10.330039 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:10.330095 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:10.330666 (+ 571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:10.330667 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:10.330667 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:10.330671 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:10.330686 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:10.330690 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:10.330733 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:10.330801 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 00:09:10.330812 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 00:09:10.336434 10991 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:10.336604 10991 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:10.342661 10991 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aba7e82835bf463998795b00219b0ae6: Generated new TSK 0
I20260812 00:09:10.342803 10991 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:10.348489 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 10896
2026-08-12T00:09:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1313 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:10 dist-test-slave-6nmv krb5kdc[11011](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:10 dist-test-slave-6nmv krb5kdc[11011](info): set up 2 sockets
Aug 12 00:09:10 dist-test-slave-6nmv krb5kdc[11011](info): commencing operation
krb5kdc: starting...
W20260812 00:09:11.437794 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:11 dist-test-slave-6nmv krb5kdc[11011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:09:11.553968 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45489
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45489
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:11.631285 11026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:11.631522 11026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:11.631563 11026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:11.632742 11026 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:11.632822 11026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:11.632846 11026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:11.632885 11026 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:11.632915 11026 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:11.634385 11026 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45489
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:11.634663 11026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:11.634883 11026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:11.639750 11032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:11.639758 11034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:11.639919 11026 server_base.cc:1034] running on GCE node
W20260812 00:09:11.639758 11036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:11.640232 11026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:11.640558 11026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:11.641727 11026 hybrid_clock.cc:648] HybridClock initialized: now 1786493351641710 us; error 39 us; skew 500 ppm
Aug 12 00:09:11 dist-test-slave-6nmv krb5kdc[11011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493351, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:11.644392 11026 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:09:11.644863 11026 webserver.cc:460] Webserver started at http://127.0.0.1:44651/ using document root <none> and password file <none>
I20260812 00:09:11.645090 11026 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:11.645133 11026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:11.645292 11026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:11.646344 11026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "eb22f610566a4c418cc25c55543eb476"
format_stamp: "Formatted at 2026-08-12 00:09:11 on dist-test-slave-6nmv"
server_key: "5cc8c4e9ff4e10085701f5f5b2ad246d"
server_key_iv: "ab236fe9ecb103c514e5669e8781245b"
server_key_version: "encryptionkey@0"
I20260812 00:09:11.646694 11026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "eb22f610566a4c418cc25c55543eb476"
format_stamp: "Formatted at 2026-08-12 00:09:11 on dist-test-slave-6nmv"
server_key: "5cc8c4e9ff4e10085701f5f5b2ad246d"
server_key_iv: "ab236fe9ecb103c514e5669e8781245b"
server_key_version: "encryptionkey@0"
I20260812 00:09:11.647976 11026 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:09:11.648644 11045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:11.648801 11026 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:11.648900 11026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "eb22f610566a4c418cc25c55543eb476"
format_stamp: "Formatted at 2026-08-12 00:09:11 on dist-test-slave-6nmv"
server_key: "5cc8c4e9ff4e10085701f5f5b2ad246d"
server_key_iv: "ab236fe9ecb103c514e5669e8781245b"
server_key_version: "encryptionkey@0"
I20260812 00:09:11.648969 11026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:11.659212 11026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:11.660764 11026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:11.660903 11026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:11.664964 11026 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45489
I20260812 00:09:11.664995 11108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45489 every 8 connection(s)
I20260812 00:09:11.665324 11026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:11.666246 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:11.668217 11109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476: Bootstrap starting.
I20260812 00:09:11.668262 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 11026
I20260812 00:09:11.668361 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:11.668529 19693 external_mini_cluster.cc:1428] Setting key 76e2eec3d5643a227d2bdfdf98870e47
I20260812 00:09:11.668859 11109 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:11.669190 11109 log.cc:824] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:11.669903 11109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476: No bootstrap required, opened a new log
I20260812 00:09:11.671892 11109 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb22f610566a4c418cc25c55543eb476" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45489 } }
I20260812 00:09:11.672052 11109 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:11.672083 11109 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb22f610566a4c418cc25c55543eb476, State: Initialized, Role: FOLLOWER
I20260812 00:09:11.672209 11109 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb22f610566a4c418cc25c55543eb476" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45489 } }
I20260812 00:09:11.672278 11109 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:11.672309 11109 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:11.672351 11109 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:11.672926 11109 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb22f610566a4c418cc25c55543eb476" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45489 } }
I20260812 00:09:11.673030 11109 leader_election.cc:302] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb22f610566a4c418cc25c55543eb476; no voters:
I20260812 00:09:11.673202 11109 leader_election.cc:288] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:11.673242 11114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:11.673425 11114 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [term 1 LEADER]: Becoming Leader. State: Replica: eb22f610566a4c418cc25c55543eb476, State: Running, Role: LEADER
I20260812 00:09:11.673448 11109 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:11.674512 11114 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb22f610566a4c418cc25c55543eb476" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45489 } }
Aug 12 00:09:11 dist-test-slave-6nmv krb5kdc[11011](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:09:11.675184 11116 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb22f610566a4c418cc25c55543eb476" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb22f610566a4c418cc25c55543eb476" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45489 } } }
I20260812 00:09:11.675266 11116 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:11.675631 11115 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb22f610566a4c418cc25c55543eb476. Latest consensus state: current_term: 1 leader_uuid: "eb22f610566a4c418cc25c55543eb476" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb22f610566a4c418cc25c55543eb476" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45489 } } }
I20260812 00:09:11.675688 11115 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:11.675706 11124 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:11.676157 11124 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:11.677910 11124 catalog_manager.cc:1347] Generated new cluster ID: a1aa445f119d4a13b8a250ba5d7d94ec
I20260812 00:09:11.677973 11124 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:11.679179 11112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:11.668994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35475 (local address 127.0.0.1:45489)
0812 00:09:11.669161 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:11.669168 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:11.669190 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:09:11.669726 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:11.669732 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:11.669786 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:11.669933 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:11.670616 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:11.671350 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:11.672441 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:11.672859 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:11.672947 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:11.675569 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:11.675573 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:11.675573 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:11.675584 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:11.677497 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:11.677938 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:11.677941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:11.677941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:11.678045 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:11.678266 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:11.678267 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:11.678268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:11.678573 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:11.678721 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:11.678824 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 00:09:11.678971 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":83,"threads_started":1}
I20260812 00:09:11.680056 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:11.686159 11124 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:11.687071 11124 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:11.688210 11112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:11.681550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58105 (local address 127.0.0.1:45489)
0812 00:09:11.681599 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:11.681602 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:11.681610 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:09:11.681651 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:11.681652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:11.681661 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:11.681717 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:11.682281 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:11.682940 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:11.683873 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:11.684194 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:11.684268 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:11.685515 (+ 1247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:11.685516 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:11.685517 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:11.685523 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:11.687056 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:11.687447 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:11.687448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:11.687448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:11.687505 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:11.687717 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:11.687717 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:11.687718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:11.687825 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:11.687908 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:11.688062 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 00:09:11.688133 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:09:11.694392 11124 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb22f610566a4c418cc25c55543eb476: Generated new TSK 0
I20260812 00:09:11.694564 11124 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:11.698191 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 11026
2026-08-12T00:09:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1351 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:11 dist-test-slave-6nmv krb5kdc[11145](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:11 dist-test-slave-6nmv krb5kdc[11145](info): set up 2 sockets
Aug 12 00:09:11 dist-test-slave-6nmv krb5kdc[11145](info): commencing operation
krb5kdc: starting...
W20260812 00:09:12.766682 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:12 dist-test-slave-6nmv krb5kdc[11145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:09:12.882741 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35263
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35263
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:12.962617 11159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:12.962792 11159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:12.962812 11159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:12.963901 11159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:12.963943 11159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:12.963958 11159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:12.963995 11159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:12.964025 11159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:12.965399 11159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35263
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:12.965610 11159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:12.965824 11159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:12.970207 11164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:12.970217 11165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:12.970350 11159 server_base.cc:1034] running on GCE node
W20260812 00:09:12.970217 11168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:12.970690 11159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:12.971014 11159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:12.972180 11159 hybrid_clock.cc:648] HybridClock initialized: now 1786493352972167 us; error 32 us; skew 500 ppm
Aug 12 00:09:12 dist-test-slave-6nmv krb5kdc[11145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493352, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:12.974697 11159 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:09:12.975121 11159 webserver.cc:460] Webserver started at http://127.0.0.1:40141/ using document root <none> and password file <none>
I20260812 00:09:12.975322 11159 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:12.975380 11159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:12.975512 11159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:12.976408 11159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "33d51904490544969952c290b2a61c5f"
format_stamp: "Formatted at 2026-08-12 00:09:12 on dist-test-slave-6nmv"
server_key: "73c1e5de5baa7ff1d3a2ab2553c729b1"
server_key_iv: "aea2bac219686020524fe07406a0c1f4"
server_key_version: "encryptionkey@0"
I20260812 00:09:12.976742 11159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "33d51904490544969952c290b2a61c5f"
format_stamp: "Formatted at 2026-08-12 00:09:12 on dist-test-slave-6nmv"
server_key: "73c1e5de5baa7ff1d3a2ab2553c729b1"
server_key_iv: "aea2bac219686020524fe07406a0c1f4"
server_key_version: "encryptionkey@0"
I20260812 00:09:12.978096 11159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:09:12.978760 11175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:12.978914 11159 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:12.979012 11159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "33d51904490544969952c290b2a61c5f"
format_stamp: "Formatted at 2026-08-12 00:09:12 on dist-test-slave-6nmv"
server_key: "73c1e5de5baa7ff1d3a2ab2553c729b1"
server_key_iv: "aea2bac219686020524fe07406a0c1f4"
server_key_version: "encryptionkey@0"
I20260812 00:09:12.979080 11159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:12.993346 11159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:12.995141 11159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:12.995290 11159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:12.999020 11159 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35263
I20260812 00:09:12.999050 11235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35263 every 8 connection(s)
I20260812 00:09:12.999369 11159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:13.000198 11236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:13.002391 11236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f: Bootstrap starting.
I20260812 00:09:13.002877 11236 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:13.003111 11236 log.cc:824] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:13.003736 11236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f: No bootstrap required, opened a new log
I20260812 00:09:13.005223 11236 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33d51904490544969952c290b2a61c5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35263 } }
I20260812 00:09:13.005347 11236 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:13.005367 11236 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33d51904490544969952c290b2a61c5f, State: Initialized, Role: FOLLOWER
I20260812 00:09:13.005460 11236 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33d51904490544969952c290b2a61c5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35263 } }
I20260812 00:09:13.005506 11236 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:13.005525 11236 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:13.005549 11236 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:13.006026 11236 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33d51904490544969952c290b2a61c5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35263 } }
I20260812 00:09:13.006105 11236 leader_election.cc:302] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33d51904490544969952c290b2a61c5f; no voters:
I20260812 00:09:13.006237 11236 leader_election.cc:288] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:13.006271 11239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:13.006387 11239 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [term 1 LEADER]: Becoming Leader. State: Replica: 33d51904490544969952c290b2a61c5f, State: Running, Role: LEADER
I20260812 00:09:13.006503 11236 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:13.006554 11239 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33d51904490544969952c290b2a61c5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35263 } }
I20260812 00:09:13.006955 11240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33d51904490544969952c290b2a61c5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33d51904490544969952c290b2a61c5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35263 } } }
I20260812 00:09:13.006984 11243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33d51904490544969952c290b2a61c5f. Latest consensus state: current_term: 1 leader_uuid: "33d51904490544969952c290b2a61c5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33d51904490544969952c290b2a61c5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35263 } } }
I20260812 00:09:13.007081 11240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:13.007162 11243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:13.007529 11247 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:13.007565 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 11159
I20260812 00:09:13.007688 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:13.007908 19693 external_mini_cluster.cc:1428] Setting key 59ebcff4718055dbf988810f79ed039b
I20260812 00:09:13.008071 11247 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:13.009825 11247 catalog_manager.cc:1347] Generated new cluster ID: 7a22bf60920f4e039e90a95dbbcb5b8f
I20260812 00:09:13.009878 11247 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:13.014233 11267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:13.008777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58029 (local address 127.0.0.1:35263)
0812 00:09:13.008953 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:13.008966 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:13.008990 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:09:13.009119 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:13.009127 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:13.009193 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:13.009358 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:13.009581 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:13.010964 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:13.012089 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:13.012717 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:13.012839 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:13.013497 (+ 658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:13.013502 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:13.013502 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:13.013708 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:13.013745 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:13.013760 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:13.013901 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:13.013965 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 00:09:13.014027 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":102,"threads_started":1}
I20260812 00:09:13.015237 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:13.019814 11267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:13.016731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45709 (local address 127.0.0.1:35263)
0812 00:09:13.016763 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:13.016764 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:13.016771 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:09:13.016790 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:13.016790 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:13.016800 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:13.016862 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:13.016966 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:13.017650 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:13.018590 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:13.018900 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:13.018970 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:13.019596 (+ 626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:13.019598 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:13.019598 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:13.019602 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:13.019615 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:13.019619 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:13.019671 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:13.019725 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 00:09:13.019748 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 00:09:13.020933 11247 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:13.021377 11247 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:13.028270 11247 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33d51904490544969952c290b2a61c5f: Generated new TSK 0
I20260812 00:09:13.028435 11247 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:13.034600 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 11159
2026-08-12T00:09:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1339 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:13 dist-test-slave-6nmv krb5kdc[11278](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:13 dist-test-slave-6nmv krb5kdc[11278](info): set up 2 sockets
Aug 12 00:09:13 dist-test-slave-6nmv krb5kdc[11278](info): commencing operation
krb5kdc: starting...
W20260812 00:09:14.095551 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:14 dist-test-slave-6nmv krb5kdc[11278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:09:14.208755 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41895
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:14.282562 11295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:14.282761 11295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:14.282791 11295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:14.283743 11295 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:14.283804 11295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:14.283824 11295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:14.283842 11295 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:14.283869 11295 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:14.285315 11295 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:14.285566 11295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:14.285768 11295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:14.290395 11305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:14.290387 11306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:14.290457 11295 server_base.cc:1034] running on GCE node
W20260812 00:09:14.290387 11308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:14.290853 11295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:14.291086 11295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:14.292255 11295 hybrid_clock.cc:648] HybridClock initialized: now 1786493354292251 us; error 36 us; skew 500 ppm
Aug 12 00:09:14 dist-test-slave-6nmv krb5kdc[11278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493354, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:14.298436 11295 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:09:14.298898 11295 webserver.cc:460] Webserver started at http://127.0.0.1:37447/ using document root <none> and password file <none>
I20260812 00:09:14.299158 11295 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:14.299226 11295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:14.299350 11295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:14.300393 11295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "8ad2d4bc790f46849ac730b925d4f2b0"
format_stamp: "Formatted at 2026-08-12 00:09:14 on dist-test-slave-6nmv"
server_key: "fffa929e632c75b38dfc768edb8e783a"
server_key_iv: "1451ca514a86da2b89926d74335310be"
server_key_version: "encryptionkey@0"
I20260812 00:09:14.300678 11295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "8ad2d4bc790f46849ac730b925d4f2b0"
format_stamp: "Formatted at 2026-08-12 00:09:14 on dist-test-slave-6nmv"
server_key: "fffa929e632c75b38dfc768edb8e783a"
server_key_iv: "1451ca514a86da2b89926d74335310be"
server_key_version: "encryptionkey@0"
I20260812 00:09:14.301874 11295 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:09:14.302538 11315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:14.302714 11295 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:14.302794 11295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "8ad2d4bc790f46849ac730b925d4f2b0"
format_stamp: "Formatted at 2026-08-12 00:09:14 on dist-test-slave-6nmv"
server_key: "fffa929e632c75b38dfc768edb8e783a"
server_key_iv: "1451ca514a86da2b89926d74335310be"
server_key_version: "encryptionkey@0"
I20260812 00:09:14.302853 11295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:14.305686 11295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:14.307273 11295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:14.307405 11295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:14.311012 11295 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41895
I20260812 00:09:14.311084 11374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41895 every 8 connection(s)
I20260812 00:09:14.311334 11295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:14.312232 11376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:14.312803 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 11295
I20260812 00:09:14.312929 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:14.313090 19693 external_mini_cluster.cc:1428] Setting key d5d0b8b449065f99a7d65ca4f1a45210
I20260812 00:09:14.315301 11376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0: Bootstrap starting.
I20260812 00:09:14.315514 11379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:14.313652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56249 (local address 127.0.0.1:41895)
0812 00:09:14.313800 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:14.313844 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:14.313874 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:09:14.314278 (+ 404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:14.314283 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:14.314306 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:14.314409 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:14.315028 (+ 619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:14.315031 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:14.315031 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:14.315035 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:14.315071 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:14.315082 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:14.315137 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:14.315235 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 00:09:14.315291 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
I20260812 00:09:14.315981 11376 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:14.316295 11376 log.cc:824] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:14.316425 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:14.316968 11376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0: No bootstrap required, opened a new log
I20260812 00:09:14.318775 11379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:14.317847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34979 (local address 127.0.0.1:41895)
0812 00:09:14.317881 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:14.317883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:14.317974 (+ 91us) server_negotiation.cc:407] Connection header received
0812 00:09:14.318036 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:14.318037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:14.318041 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:14.318091 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:14.318586 (+ 495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:14.318587 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:14.318587 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:14.318591 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:14.318602 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:14.318605 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:14.318656 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:14.318706 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 00:09:14.318719 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:09:14.319176 11376 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad2d4bc790f46849ac730b925d4f2b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41895 } }
I20260812 00:09:14.319319 11376 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:14.319343 11376 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ad2d4bc790f46849ac730b925d4f2b0, State: Initialized, Role: FOLLOWER
I20260812 00:09:14.319434 11376 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad2d4bc790f46849ac730b925d4f2b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41895 } }
I20260812 00:09:14.319489 11376 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:14.319510 11376 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:14.319541 11376 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:14.319972 11376 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad2d4bc790f46849ac730b925d4f2b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41895 } }
I20260812 00:09:14.320055 11376 leader_election.cc:302] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ad2d4bc790f46849ac730b925d4f2b0; no voters:
I20260812 00:09:14.320168 11376 leader_election.cc:288] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:14.320223 11386 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:14.320369 11376 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:14.320391 11386 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 8ad2d4bc790f46849ac730b925d4f2b0, State: Running, Role: LEADER
I20260812 00:09:14.320463 11386 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad2d4bc790f46849ac730b925d4f2b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41895 } }
I20260812 00:09:14.320834 11388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ad2d4bc790f46849ac730b925d4f2b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad2d4bc790f46849ac730b925d4f2b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41895 } } }
I20260812 00:09:14.320978 11388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:14.320834 11389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ad2d4bc790f46849ac730b925d4f2b0. Latest consensus state: current_term: 1 leader_uuid: "8ad2d4bc790f46849ac730b925d4f2b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad2d4bc790f46849ac730b925d4f2b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41895 } } }
I20260812 00:09:14.321362 11389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:14.321179 11398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:14.321934 11398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:14.323418 11398 catalog_manager.cc:1347] Generated new cluster ID: 3e2f5015265942afb16fce0714c083b9
I20260812 00:09:14.323491 11398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:14.332552 11398 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:14.332686 11398 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:14.335740 11398 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ad2d4bc790f46849ac730b925d4f2b0: Generated new TSK 0
I20260812 00:09:14.335886 11398 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:14.339473 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 11295
2026-08-12T00:09:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1301 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:14 dist-test-slave-6nmv krb5kdc[11413](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:14 dist-test-slave-6nmv krb5kdc[11413](info): set up 2 sockets
Aug 12 00:09:14 dist-test-slave-6nmv krb5kdc[11413](info): commencing operation
krb5kdc: starting...
W20260812 00:09:15.402375 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:15 dist-test-slave-6nmv krb5kdc[11413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493355, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:09:15.512871 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33037
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:15.587644 11428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:15.587903 11428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:15.587939 11428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:15.589073 11428 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:15.589138 11428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:15.589162 11428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:15.589195 11428 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:15.589217 11428 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:15.590670 11428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:15.590942 11428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:15.591154 11428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:09:15.595793 11428 server_base.cc:1034] running on GCE node
W20260812 00:09:15.595767 11436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:15.595755 11435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:15.595767 11439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:15.596194 11428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:15.596460 11428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:15.597613 11428 hybrid_clock.cc:648] HybridClock initialized: now 1786493355597608 us; error 34 us; skew 500 ppm
Aug 12 00:09:15 dist-test-slave-6nmv krb5kdc[11413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493355, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:15.603416 11428 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:09:15.603837 11428 webserver.cc:460] Webserver started at http://127.0.0.1:35809/ using document root <none> and password file <none>
I20260812 00:09:15.604029 11428 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:15.604071 11428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:15.604177 11428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:15.605120 11428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "d71119fd557e4cf4b4d5ff84b9e2caf8"
format_stamp: "Formatted at 2026-08-12 00:09:15 on dist-test-slave-6nmv"
server_key: "e94f2a9600451e621372b0990e76b373"
server_key_iv: "0575d8b2305b8257940cb4ac39a6a6fb"
server_key_version: "encryptionkey@0"
I20260812 00:09:15.605414 11428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "d71119fd557e4cf4b4d5ff84b9e2caf8"
format_stamp: "Formatted at 2026-08-12 00:09:15 on dist-test-slave-6nmv"
server_key: "e94f2a9600451e621372b0990e76b373"
server_key_iv: "0575d8b2305b8257940cb4ac39a6a6fb"
server_key_version: "encryptionkey@0"
I20260812 00:09:15.606822 11428 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:09:15.607635 11446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:15.607815 11428 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:09:15.607928 11428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "d71119fd557e4cf4b4d5ff84b9e2caf8"
format_stamp: "Formatted at 2026-08-12 00:09:15 on dist-test-slave-6nmv"
server_key: "e94f2a9600451e621372b0990e76b373"
server_key_iv: "0575d8b2305b8257940cb4ac39a6a6fb"
server_key_version: "encryptionkey@0"
I20260812 00:09:15.608001 11428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:15.624804 11428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:15.626677 11428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:15.626825 11428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:15.630575 11428 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33037
I20260812 00:09:15.630625 11503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33037 every 8 connection(s)
I20260812 00:09:15.630985 11428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:15.631844 11504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:15.634023 11504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8: Bootstrap starting.
I20260812 00:09:15.634550 11504 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:15.634779 11504 log.cc:824] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:15.635450 11504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8: No bootstrap required, opened a new log
I20260812 00:09:15.636833 11504 raft_consensus.cc:348] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d71119fd557e4cf4b4d5ff84b9e2caf8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33037 } }
I20260812 00:09:15.636953 11504 raft_consensus.cc:374] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:15.636973 11504 raft_consensus.cc:729] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d71119fd557e4cf4b4d5ff84b9e2caf8, State: Initialized, Role: FOLLOWER
I20260812 00:09:15.637109 11504 consensus_queue.cc:260] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d71119fd557e4cf4b4d5ff84b9e2caf8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33037 } }
I20260812 00:09:15.637197 11504 raft_consensus.cc:388] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:15.637228 11504 raft_consensus.cc:482] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:15.637225 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 11428
I20260812 00:09:15.637280 11504 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:15.637326 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:15.637508 19693 external_mini_cluster.cc:1428] Setting key c36500bc2a6f344839589ab3245c9959
I20260812 00:09:15.637979 11504 raft_consensus.cc:504] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d71119fd557e4cf4b4d5ff84b9e2caf8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33037 } }
I20260812 00:09:15.638099 11504 leader_election.cc:302] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d71119fd557e4cf4b4d5ff84b9e2caf8; no voters:
I20260812 00:09:15.638334 11504 leader_election.cc:288] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:15.638371 11509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:15.638520 11509 raft_consensus.cc:686] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [term 1 LEADER]: Becoming Leader. State: Replica: d71119fd557e4cf4b4d5ff84b9e2caf8, State: Running, Role: LEADER
I20260812 00:09:15.638614 11504 sys_catalog.cc:564] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:15.638669 11509 consensus_queue.cc:237] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d71119fd557e4cf4b4d5ff84b9e2caf8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33037 } }
I20260812 00:09:15.639195 11510 sys_catalog.cc:455] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d71119fd557e4cf4b4d5ff84b9e2caf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d71119fd557e4cf4b4d5ff84b9e2caf8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33037 } } }
I20260812 00:09:15.639281 11510 sys_catalog.cc:458] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:15.639201 11511 sys_catalog.cc:455] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d71119fd557e4cf4b4d5ff84b9e2caf8. Latest consensus state: current_term: 1 leader_uuid: "d71119fd557e4cf4b4d5ff84b9e2caf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d71119fd557e4cf4b4d5ff84b9e2caf8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33037 } } }
I20260812 00:09:15.639554 11511 sys_catalog.cc:458] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:15.639810 11519 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:15.640272 11519 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:15.641860 11519 catalog_manager.cc:1347] Generated new cluster ID: f9613280647c4052ad2d7a6d468330f5
I20260812 00:09:15.641911 11519 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:09:15 dist-test-slave-6nmv krb5kdc[11413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493355, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:09:15.649118 11508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:15.638052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:43755 (local address 127.0.0.1:33037)
0812 00:09:15.638196 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:15.638204 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:15.638297 (+ 93us) server_negotiation.cc:407] Connection header received
0812 00:09:15.638456 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:15.638464 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:15.638523 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:15.639365 (+ 842us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:15.639504 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:15.640868 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:15.641878 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:15.642440 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:15.642557 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:15.645356 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:15.645359 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:15.645360 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:15.645370 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:15.647593 (+ 2223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:15.648008 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:15.648010 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:15.648010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:15.648114 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:15.648339 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:15.648340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:15.648340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:15.648585 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:15.648724 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:15.648839 (+ 115us) server_negotiation.cc:299] Negotiation successful
0812 00:09:15.648931 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":71,"threads_started":1}
I20260812 00:09:15.649987 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:15.658118 11508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:15.651327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:48695 (local address 127.0.0.1:33037)
0812 00:09:15.651374 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:15.651375 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:15.651466 (+ 91us) server_negotiation.cc:407] Connection header received
0812 00:09:15.651503 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:15.651503 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:15.651511 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:15.651579 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:15.652128 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:15.652802 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:15.653620 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:15.653960 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:15.654015 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:15.655317 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:15.655319 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:15.655319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:15.655325 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:15.656928 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:15.657301 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:15.657302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:15.657302 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:15.657356 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:15.657574 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:15.657575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:15.657575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:15.657690 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:15.657789 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:15.657972 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 00:09:15.658035 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 00:09:15.663604 11519 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:15.664113 11519 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:15.676430 11519 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d71119fd557e4cf4b4d5ff84b9e2caf8: Generated new TSK 0
I20260812 00:09:15.676637 11519 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:15.680029 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 11428
W20260812 00:09:15.688679 11411 connection.cc:535] client connection to 127.0.0.1:33037 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33037): Connection reset by peer (error 104)
2026-08-12T00:09:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1340 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:15 dist-test-slave-6nmv krb5kdc[11543](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:15 dist-test-slave-6nmv krb5kdc[11543](info): set up 2 sockets
Aug 12 00:09:15 dist-test-slave-6nmv krb5kdc[11543](info): commencing operation
krb5kdc: starting...
W20260812 00:09:16.747231 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:16 dist-test-slave-6nmv krb5kdc[11543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:09:16.862727 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44769
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44769
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:16.941210 11561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:16.941411 11561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:16.941433 11561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:16.942466 11561 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:16.942502 11561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:16.942515 11561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:16.942528 11561 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:16.942539 11561 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:16.943887 11561 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:16.944070 11561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:16.944244 11561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:16.948937 11566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:16.948918 11567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:16.949005 11561 server_base.cc:1034] running on GCE node
W20260812 00:09:16.948918 11570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:16.949415 11561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:16.949704 11561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:16.950842 11561 hybrid_clock.cc:648] HybridClock initialized: now 1786493356950836 us; error 31 us; skew 500 ppm
Aug 12 00:09:16 dist-test-slave-6nmv krb5kdc[11543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493356, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:16.953312 11561 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:09:16.953789 11561 webserver.cc:460] Webserver started at http://127.0.0.1:36821/ using document root <none> and password file <none>
I20260812 00:09:16.954052 11561 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:16.954123 11561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:16.954281 11561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:16.955279 11561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "ea61b07539184e0bb0af75f3238edde9"
format_stamp: "Formatted at 2026-08-12 00:09:16 on dist-test-slave-6nmv"
server_key: "d3073bec7845c8d477c18b5adda09040"
server_key_iv: "afc04ac09bb9f71245f883400137e545"
server_key_version: "encryptionkey@0"
I20260812 00:09:16.955644 11561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "ea61b07539184e0bb0af75f3238edde9"
format_stamp: "Formatted at 2026-08-12 00:09:16 on dist-test-slave-6nmv"
server_key: "d3073bec7845c8d477c18b5adda09040"
server_key_iv: "afc04ac09bb9f71245f883400137e545"
server_key_version: "encryptionkey@0"
I20260812 00:09:16.956873 11561 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:09:16.957605 11578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:16.957779 11561 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:09:16.957898 11561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "ea61b07539184e0bb0af75f3238edde9"
format_stamp: "Formatted at 2026-08-12 00:09:16 on dist-test-slave-6nmv"
server_key: "d3073bec7845c8d477c18b5adda09040"
server_key_iv: "afc04ac09bb9f71245f883400137e545"
server_key_version: "encryptionkey@0"
I20260812 00:09:16.957983 11561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:16.970907 11561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:16.972599 11561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:16.972750 11561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:16.976686 11561 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44769
I20260812 00:09:16.976733 11637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44769 every 8 connection(s)
I20260812 00:09:16.977072 11561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:16.977594 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 11561
I20260812 00:09:16.977725 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:16.977945 19693 external_mini_cluster.cc:1428] Setting key f92d11c6526fe2fe5deba170f78aba6a
I20260812 00:09:16.978096 11638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:16.980669 11638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9: Bootstrap starting.
I20260812 00:09:16.981247 11638 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:16.981544 11638 log.cc:824] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:16.982323 11638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9: No bootstrap required, opened a new log
I20260812 00:09:16.983152 11641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:16.978415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:54013 (local address 127.0.0.1:44769)
0812 00:09:16.978615 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:16.978624 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:16.978653 (+ 29us) server_negotiation.cc:407] Connection header received
0812 00:09:16.979103 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:16.979109 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:16.979152 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:16.979288 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:16.979524 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:16.980355 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:16.981195 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:16.981709 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:16.981850 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:16.982521 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:16.982525 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:16.982526 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:16.982709 (+ 183us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:16.982746 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:16.982760 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:16.982857 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:16.982928 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:09:16.982954 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":93,"threads_started":1}
I20260812 00:09:16.984193 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:16.984745 11638 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea61b07539184e0bb0af75f3238edde9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44769 } }
I20260812 00:09:16.984920 11638 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:16.984977 11638 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea61b07539184e0bb0af75f3238edde9, State: Initialized, Role: FOLLOWER
I20260812 00:09:16.985109 11638 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea61b07539184e0bb0af75f3238edde9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44769 } }
I20260812 00:09:16.985183 11638 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:16.985224 11638 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:16.985280 11638 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:16.986094 11638 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea61b07539184e0bb0af75f3238edde9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44769 } }
I20260812 00:09:16.986210 11638 leader_election.cc:302] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea61b07539184e0bb0af75f3238edde9; no voters:
I20260812 00:09:16.986399 11638 leader_election.cc:288] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:16.986428 11648 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:16.986552 11648 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [term 1 LEADER]: Becoming Leader. State: Replica: ea61b07539184e0bb0af75f3238edde9, State: Running, Role: LEADER
I20260812 00:09:16.986651 11638 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:16.986718 11648 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea61b07539184e0bb0af75f3238edde9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44769 } }
I20260812 00:09:16.987107 11648 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea61b07539184e0bb0af75f3238edde9. Latest consensus state: current_term: 1 leader_uuid: "ea61b07539184e0bb0af75f3238edde9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea61b07539184e0bb0af75f3238edde9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44769 } } }
I20260812 00:09:16.987356 11648 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:16.987277 11650 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea61b07539184e0bb0af75f3238edde9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea61b07539184e0bb0af75f3238edde9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44769 } } }
I20260812 00:09:16.987762 11650 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:16.988132 11659 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:16.988600 11659 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:16.989233 11641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:16.985737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:39475 (local address 127.0.0.1:44769)
0812 00:09:16.985782 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:16.985784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:16.985923 (+ 139us) server_negotiation.cc:407] Connection header received
0812 00:09:16.985991 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:16.985992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:16.985999 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:16.986054 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:16.986196 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:16.986774 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:16.987795 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:16.988138 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:16.988205 (+ 67us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:16.988906 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:16.988907 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:16.988908 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:16.988912 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:16.988927 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:16.988931 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:16.989010 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:16.989152 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 00:09:16.989162 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:09:16.990514 11659 catalog_manager.cc:1347] Generated new cluster ID: 3637b1149caa471ba4335508ded68f8a
I20260812 00:09:16.990573 11659 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:17.040618 11659 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:17.041383 11659 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:17.056833 11659 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea61b07539184e0bb0af75f3238edde9: Generated new TSK 0
I20260812 00:09:17.057027 11659 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:17.072655 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 11561
W20260812 00:09:17.079871 11541 connection.cc:535] client connection to 127.0.0.1:44769 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44769): Connection reset by peer (error 104)
2026-08-12T00:09:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1391 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:17 dist-test-slave-6nmv krb5kdc[11674](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:17 dist-test-slave-6nmv krb5kdc[11674](info): set up 2 sockets
Aug 12 00:09:17 dist-test-slave-6nmv krb5kdc[11674](info): commencing operation
krb5kdc: starting...
W20260812 00:09:18.141471 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:18 dist-test-slave-6nmv krb5kdc[11674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493358, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:09:18.257368 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41747
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41747
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:18.334869 11691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:18.335091 11691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:18.335132 11691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:18.336261 11691 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:18.336323 11691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:18.336346 11691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:18.336372 11691 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:18.336401 11691 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:18.337707 11691 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41747
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:18.337960 11691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:18.338189 11691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:18.342517 11700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:18.342540 11698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:18.342700 11691 server_base.cc:1034] running on GCE node
W20260812 00:09:18.342738 11697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:18.343014 11691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:18.343272 11691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:18.344420 11691 hybrid_clock.cc:648] HybridClock initialized: now 1786493358344401 us; error 39 us; skew 500 ppm
Aug 12 00:09:18 dist-test-slave-6nmv krb5kdc[11674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493358, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:18.346800 11691 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:09:18.347216 11691 webserver.cc:460] Webserver started at http://127.0.0.1:33831/ using document root <none> and password file <none>
I20260812 00:09:18.347424 11691 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:18.347467 11691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:18.347622 11691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:18.348573 11691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "e72e61c662e44944a8f569354978005e"
format_stamp: "Formatted at 2026-08-12 00:09:18 on dist-test-slave-6nmv"
server_key: "2ca67e7eafde790f1bdb754653aa2dcd"
server_key_iv: "b6bde4c2c24c1819e0330265277d14c6"
server_key_version: "encryptionkey@0"
I20260812 00:09:18.348919 11691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "e72e61c662e44944a8f569354978005e"
format_stamp: "Formatted at 2026-08-12 00:09:18 on dist-test-slave-6nmv"
server_key: "2ca67e7eafde790f1bdb754653aa2dcd"
server_key_iv: "b6bde4c2c24c1819e0330265277d14c6"
server_key_version: "encryptionkey@0"
I20260812 00:09:18.350409 11691 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:09:18.351202 11710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:18.351390 11691 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:09:18.351483 11691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "e72e61c662e44944a8f569354978005e"
format_stamp: "Formatted at 2026-08-12 00:09:18 on dist-test-slave-6nmv"
server_key: "2ca67e7eafde790f1bdb754653aa2dcd"
server_key_iv: "b6bde4c2c24c1819e0330265277d14c6"
server_key_version: "encryptionkey@0"
I20260812 00:09:18.351554 11691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:18.354763 11691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:18.357147 11691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:18.357299 11691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:18.361090 11691 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41747
I20260812 00:09:18.361119 11767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41747 every 8 connection(s)
I20260812 00:09:18.361446 11691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:18.361729 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 11691
I20260812 00:09:18.361869 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:18.362082 19693 external_mini_cluster.cc:1428] Setting key 068c545485f4532531f15f6c798007e7
I20260812 00:09:18.362203 11768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:18.364624 11771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:18.362609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:46163 (local address 127.0.0.1:41747)
0812 00:09:18.362808 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:18.362816 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:18.362850 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:09:18.363375 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:18.363383 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:18.363416 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:18.363568 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:18.364160 (+ 592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:18.364164 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:18.364164 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:18.364170 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:18.364215 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:18.364230 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:18.364320 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:18.364379 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 00:09:18.364420 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":90,"threads_started":1}
I20260812 00:09:18.365657 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:18.365798 11768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e: Bootstrap starting.
I20260812 00:09:18.366520 11768 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:18.366870 11768 log.cc:824] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:18.367543 11768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e: No bootstrap required, opened a new log
I20260812 00:09:18.368275 11771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:18.367225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:34259 (local address 127.0.0.1:41747)
0812 00:09:18.367255 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:18.367257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:18.367387 (+ 130us) server_negotiation.cc:407] Connection header received
0812 00:09:18.367457 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:18.367458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:18.367463 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:18.367537 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:18.368072 (+ 535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:18.368073 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:18.368073 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:18.368077 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:18.368090 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:18.368093 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:18.368148 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:18.368205 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 00:09:18.368218 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 00:09:18.369315 11768 raft_consensus.cc:348] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e72e61c662e44944a8f569354978005e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41747 } }
I20260812 00:09:18.369428 11768 raft_consensus.cc:374] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:18.369449 11768 raft_consensus.cc:729] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72e61c662e44944a8f569354978005e, State: Initialized, Role: FOLLOWER
I20260812 00:09:18.369576 11768 consensus_queue.cc:260] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e72e61c662e44944a8f569354978005e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41747 } }
I20260812 00:09:18.369642 11768 raft_consensus.cc:388] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:18.369663 11768 raft_consensus.cc:482] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:18.369724 11768 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:18.370316 11768 raft_consensus.cc:504] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e72e61c662e44944a8f569354978005e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41747 } }
I20260812 00:09:18.370416 11768 leader_election.cc:302] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e72e61c662e44944a8f569354978005e; no voters:
I20260812 00:09:18.370564 11768 leader_election.cc:288] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:18.370630 11779 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:18.370776 11768 sys_catalog.cc:564] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:18.370853 11779 raft_consensus.cc:686] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [term 1 LEADER]: Becoming Leader. State: Replica: e72e61c662e44944a8f569354978005e, State: Running, Role: LEADER
I20260812 00:09:18.371060 11779 consensus_queue.cc:237] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e72e61c662e44944a8f569354978005e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41747 } }
I20260812 00:09:18.371536 11782 sys_catalog.cc:455] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e72e61c662e44944a8f569354978005e. Latest consensus state: current_term: 1 leader_uuid: "e72e61c662e44944a8f569354978005e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e72e61c662e44944a8f569354978005e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41747 } } }
I20260812 00:09:18.371665 11782 sys_catalog.cc:458] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:18.371898 11789 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:18.372022 11780 sys_catalog.cc:455] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e72e61c662e44944a8f569354978005e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e72e61c662e44944a8f569354978005e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41747 } } }
I20260812 00:09:18.372105 11780 sys_catalog.cc:458] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:18.372462 11789 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:18.373992 11789 catalog_manager.cc:1347] Generated new cluster ID: 59b77e59dfe547f19185c2c83f77f89b
I20260812 00:09:18.374050 11789 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:18.386291 11789 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:18.386451 11789 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:18.389794 11789 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e72e61c662e44944a8f569354978005e: Generated new TSK 0
I20260812 00:09:18.389981 11789 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:18.392911 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 11691
2026-08-12T00:09:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1321 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:18 dist-test-slave-6nmv krb5kdc[11802](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:18 dist-test-slave-6nmv krb5kdc[11802](info): set up 2 sockets
Aug 12 00:09:18 dist-test-slave-6nmv krb5kdc[11802](info): commencing operation
krb5kdc: starting...
W20260812 00:09:19.488819 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:19 dist-test-slave-6nmv krb5kdc[11802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493359, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:09:19.598603 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41977
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:19.680693 11820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:19.680866 11820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:19.680884 11820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:19.681995 11820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:19.682050 11820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:19.682063 11820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:19.682073 11820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:19.682117 11820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:19.683473 11820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41977
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:19.683676 11820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:19.683897 11820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:19.688627 11826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:19.688740 11829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:19.688752 11820 server_base.cc:1034] running on GCE node
W20260812 00:09:19.688627 11825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:19.689085 11820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:19.689352 11820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:19.690497 11820 hybrid_clock.cc:648] HybridClock initialized: now 1786493359690477 us; error 35 us; skew 500 ppm
Aug 12 00:09:19 dist-test-slave-6nmv krb5kdc[11802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493359, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:19.692976 11820 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:09:19.693332 11820 webserver.cc:460] Webserver started at http://127.0.0.1:38513/ using document root <none> and password file <none>
I20260812 00:09:19.693529 11820 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:19.693568 11820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:19.693652 11820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:19.694665 11820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "0d92be87a2af4cf4a7e7a9085edfd819"
format_stamp: "Formatted at 2026-08-12 00:09:19 on dist-test-slave-6nmv"
server_key: "72886155fa02a3002c681690cb213d45"
server_key_iv: "a3076aaab55f35ab6f8a290da9bacc2d"
server_key_version: "encryptionkey@0"
I20260812 00:09:19.695029 11820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "0d92be87a2af4cf4a7e7a9085edfd819"
format_stamp: "Formatted at 2026-08-12 00:09:19 on dist-test-slave-6nmv"
server_key: "72886155fa02a3002c681690cb213d45"
server_key_iv: "a3076aaab55f35ab6f8a290da9bacc2d"
server_key_version: "encryptionkey@0"
I20260812 00:09:19.696277 11820 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:09:19.696923 11837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:19.697098 11820 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:09:19.697201 11820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "0d92be87a2af4cf4a7e7a9085edfd819"
format_stamp: "Formatted at 2026-08-12 00:09:19 on dist-test-slave-6nmv"
server_key: "72886155fa02a3002c681690cb213d45"
server_key_iv: "a3076aaab55f35ab6f8a290da9bacc2d"
server_key_version: "encryptionkey@0"
I20260812 00:09:19.697274 11820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:19.703148 11820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:19.704774 11820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:19.704927 11820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:19.708523 11820 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41977
I20260812 00:09:19.708583 11897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41977 every 8 connection(s)
I20260812 00:09:19.708889 11820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:19.709663 11898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:19.711745 11898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819: Bootstrap starting.
I20260812 00:09:19.712281 11898 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:19.712570 11898 log.cc:824] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:19.712745 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 11820
I20260812 00:09:19.712879 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:19.713075 19693 external_mini_cluster.cc:1428] Setting key 58a24b7fd028892a06423cbae10b176f
I20260812 00:09:19.713311 11898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819: No bootstrap required, opened a new log
I20260812 00:09:19.715054 11898 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d92be87a2af4cf4a7e7a9085edfd819" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41977 } }
I20260812 00:09:19.715209 11898 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:19.715247 11898 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d92be87a2af4cf4a7e7a9085edfd819, State: Initialized, Role: FOLLOWER
I20260812 00:09:19.715425 11898 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d92be87a2af4cf4a7e7a9085edfd819" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41977 } }
I20260812 00:09:19.715519 11898 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:19.715552 11898 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:19.715605 11898 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:19.716569 11898 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d92be87a2af4cf4a7e7a9085edfd819" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41977 } }
I20260812 00:09:19.716687 11898 leader_election.cc:302] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d92be87a2af4cf4a7e7a9085edfd819; no voters:
I20260812 00:09:19.716881 11898 leader_election.cc:288] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:19.716903 11903 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:19.717012 11903 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [term 1 LEADER]: Becoming Leader. State: Replica: 0d92be87a2af4cf4a7e7a9085edfd819, State: Running, Role: LEADER
I20260812 00:09:19.717141 11898 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:19.717144 11903 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d92be87a2af4cf4a7e7a9085edfd819" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41977 } }
I20260812 00:09:19.717612 11905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d92be87a2af4cf4a7e7a9085edfd819. Latest consensus state: current_term: 1 leader_uuid: "0d92be87a2af4cf4a7e7a9085edfd819" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d92be87a2af4cf4a7e7a9085edfd819" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41977 } } }
I20260812 00:09:19.717703 11905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:19.717958 11904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d92be87a2af4cf4a7e7a9085edfd819" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d92be87a2af4cf4a7e7a9085edfd819" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41977 } } }
I20260812 00:09:19.718086 11904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:19.718253 11911 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:19.718858 11911 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:19.720461 11911 catalog_manager.cc:1347] Generated new cluster ID: 0f196de8faa940ebbc885a54d3cbcb12
I20260812 00:09:19.720513 11911 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:09:19 dist-test-slave-6nmv krb5kdc[11802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493359, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:09:19.725421 11902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:19.713559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:34853 (local address 127.0.0.1:41977)
0812 00:09:19.713729 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:19.713735 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:19.713758 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:09:19.715035 (+ 1277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:19.715041 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:19.715088 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:19.715196 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:19.716065 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:19.717057 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:19.718176 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:19.718839 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:19.719355 (+ 516us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:19.721830 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:19.721834 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:19.721835 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:19.721848 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:19.723729 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:19.724132 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:19.724135 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:19.724135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:19.724276 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:19.724540 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:19.724541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:19.724542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:19.724844 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:19.725021 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:19.725100 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 00:09:19.725204 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":74,"threads_started":1}
I20260812 00:09:19.726521 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:19.733543 11911 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:19.734207 11911 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:19.735198 11902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:19.728104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:46601 (local address 127.0.0.1:41977)
0812 00:09:19.728139 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:19.728141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:19.728149 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:09:19.728170 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:19.728171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:19.728179 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:19.728242 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:19.728792 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:19.729546 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:19.730500 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:19.730815 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:19.730887 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:19.732177 (+ 1290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:19.732179 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:19.732179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:19.732186 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:19.733975 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:19.734392 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:19.734393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:19.734393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:19.734457 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:19.734705 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:19.734706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:19.734706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:19.734829 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:19.734940 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:19.735050 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 00:09:19.735112 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:09:19.741487 11911 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0d92be87a2af4cf4a7e7a9085edfd819: Generated new TSK 0
I20260812 00:09:19.741633 11911 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:19.744364 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 11820
W20260812 00:09:19.750788 11800 connection.cc:535] client connection to 127.0.0.1:41977 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41977): Connection reset by peer (error 104)
2026-08-12T00:09:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1349 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:19 dist-test-slave-6nmv krb5kdc[11936](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:19 dist-test-slave-6nmv krb5kdc[11936](info): set up 2 sockets
Aug 12 00:09:19 dist-test-slave-6nmv krb5kdc[11936](info): commencing operation
krb5kdc: starting...
W20260812 00:09:20.824355 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:20 dist-test-slave-6nmv krb5kdc[11936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:09:20.941938 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39037
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:21.018770 11949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:21.018944 11949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:21.018965 11949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:21.020033 11949 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:21.020074 11949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:21.020087 11949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:21.020139 11949 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:21.020166 11949 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:21.021517 11949 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39037
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:21.021752 11949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:21.021975 11949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:21.027055 11958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:21.027195 11955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:21.027056 11956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:21.027209 11949 server_base.cc:1034] running on GCE node
I20260812 00:09:21.027472 11949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:21.027680 11949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:21.028821 11949 hybrid_clock.cc:648] HybridClock initialized: now 1786493361028813 us; error 25 us; skew 500 ppm
Aug 12 00:09:21 dist-test-slave-6nmv krb5kdc[11936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493361, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:21.036407 11949 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:09:21.036844 11949 webserver.cc:460] Webserver started at http://127.0.0.1:35567/ using document root <none> and password file <none>
I20260812 00:09:21.037051 11949 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:21.037114 11949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:21.037251 11949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:21.038240 11949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "32c9b95b5a6440959842a4b883abd46d"
format_stamp: "Formatted at 2026-08-12 00:09:21 on dist-test-slave-6nmv"
server_key: "ad2d177d709fb8e9a464df4856a118a5"
server_key_iv: "748abd4cff67b3c406ff4d496cf6c2bb"
server_key_version: "encryptionkey@0"
I20260812 00:09:21.038604 11949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "32c9b95b5a6440959842a4b883abd46d"
format_stamp: "Formatted at 2026-08-12 00:09:21 on dist-test-slave-6nmv"
server_key: "ad2d177d709fb8e9a464df4856a118a5"
server_key_iv: "748abd4cff67b3c406ff4d496cf6c2bb"
server_key_version: "encryptionkey@0"
I20260812 00:09:21.039826 11949 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:09:21.040501 11967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:21.040657 11949 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:21.040755 11949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "32c9b95b5a6440959842a4b883abd46d"
format_stamp: "Formatted at 2026-08-12 00:09:21 on dist-test-slave-6nmv"
server_key: "ad2d177d709fb8e9a464df4856a118a5"
server_key_iv: "748abd4cff67b3c406ff4d496cf6c2bb"
server_key_version: "encryptionkey@0"
I20260812 00:09:21.040822 11949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:21.060638 11949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:21.062839 11949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:21.062987 11949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:21.066895 11949 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39037
I20260812 00:09:21.066926 12027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39037 every 8 connection(s)
I20260812 00:09:21.067269 11949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:21.068017 12028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:21.070154 12028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d: Bootstrap starting.
I20260812 00:09:21.070719 12028 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:21.071010 12028 log.cc:824] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:21.071683 12028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d: No bootstrap required, opened a new log
I20260812 00:09:21.073148 12028 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32c9b95b5a6440959842a4b883abd46d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39037 } }
I20260812 00:09:21.073272 12028 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:21.073318 12028 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32c9b95b5a6440959842a4b883abd46d, State: Initialized, Role: FOLLOWER
I20260812 00:09:21.073468 12028 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32c9b95b5a6440959842a4b883abd46d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39037 } }
I20260812 00:09:21.073537 12028 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:21.073557 12028 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:21.073633 12028 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:21.074201 12028 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32c9b95b5a6440959842a4b883abd46d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39037 } }
I20260812 00:09:21.074309 12028 leader_election.cc:302] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32c9b95b5a6440959842a4b883abd46d; no voters:
I20260812 00:09:21.074457 12028 leader_election.cc:288] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:21.074493 12031 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:21.074734 12031 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [term 1 LEADER]: Becoming Leader. State: Replica: 32c9b95b5a6440959842a4b883abd46d, State: Running, Role: LEADER
I20260812 00:09:21.074729 12028 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:21.074913 12031 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32c9b95b5a6440959842a4b883abd46d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39037 } }
I20260812 00:09:21.075429 12032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32c9b95b5a6440959842a4b883abd46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32c9b95b5a6440959842a4b883abd46d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39037 } } }
I20260812 00:09:21.075515 12032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:21.075726 12041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:21.075865 12033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32c9b95b5a6440959842a4b883abd46d. Latest consensus state: current_term: 1 leader_uuid: "32c9b95b5a6440959842a4b883abd46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32c9b95b5a6440959842a4b883abd46d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39037 } } }
I20260812 00:09:21.075937 12033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:21.076236 12041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:21.076388 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 11949
I20260812 00:09:21.076520 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:21.076699 19693 external_mini_cluster.cc:1428] Setting key 87073d575ab592c38e4ef5627c8b328f
I20260812 00:09:21.077908 12041 catalog_manager.cc:1347] Generated new cluster ID: f4c277dce6cd48bda3a37066c0319102
I20260812 00:09:21.077960 12041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:21.082933 12052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:21.077272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:33745 (local address 127.0.0.1:39037)
0812 00:09:21.077481 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:21.077491 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:21.077522 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:09:21.077631 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:21.077636 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:21.077676 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:21.078137 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:21.078216 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:21.079476 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:21.080599 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:21.081155 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:21.081249 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:21.081952 (+ 703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:21.081956 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:21.081957 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:21.082177 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:21.082215 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:21.082230 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:21.082322 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:21.082430 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 00:09:21.082457 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":103,"threads_started":1}
I20260812 00:09:21.083948 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:21.089758 12041 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:21.090425 12041 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:21.092967 12052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:21.089520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:48577 (local address 127.0.0.1:39037)
0812 00:09:21.089563 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:21.089565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:21.089747 (+ 182us) server_negotiation.cc:407] Connection header received
0812 00:09:21.089805 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:21.089822 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:21.089833 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:21.089891 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:21.090075 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:21.090719 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:21.091718 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:21.092008 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:21.092064 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:21.092711 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:21.092712 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:21.092713 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:21.092716 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:21.092730 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:21.092734 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:21.092786 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:21.092869 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 00:09:21.092880 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:09:21.094462 12041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32c9b95b5a6440959842a4b883abd46d: Generated new TSK 0
I20260812 00:09:21.094643 12041 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:21.097016 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 11949
W20260812 00:09:21.107800 11934 connection.cc:535] client connection to 127.0.0.1:39037 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39037): Connection reset by peer (error 104)
2026-08-12T00:09:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1356 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:21 dist-test-slave-6nmv krb5kdc[12061](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:21 dist-test-slave-6nmv krb5kdc[12061](info): set up 2 sockets
Aug 12 00:09:21 dist-test-slave-6nmv krb5kdc[12061](info): commencing operation
krb5kdc: starting...
W20260812 00:09:22.163942 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:22 dist-test-slave-6nmv krb5kdc[12061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:09:22.279878 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40693
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40693
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:22.360364 12075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:22.360584 12075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:22.360608 12075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:22.361634 12075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:22.361672 12075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:22.361688 12075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:22.361702 12075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:22.361716 12075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:22.363101 12075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40693
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12075
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:22.363291 12075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:22.363461 12075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:22.368384 12085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:22.368454 12080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:22.368384 12083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:22.368412 12075 server_base.cc:1034] running on GCE node
I20260812 00:09:22.368921 12075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:22.369215 12075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:22.370373 12075 hybrid_clock.cc:648] HybridClock initialized: now 1786493362370360 us; error 28 us; skew 500 ppm
Aug 12 00:09:22 dist-test-slave-6nmv krb5kdc[12061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493362, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:22.372838 12075 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:09:22.373176 12075 webserver.cc:460] Webserver started at http://127.0.0.1:39217/ using document root <none> and password file <none>
I20260812 00:09:22.373339 12075 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:22.373375 12075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:22.373457 12075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:22.374527 12075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "f69ee21a299f4b4a89d92676248e0a82"
format_stamp: "Formatted at 2026-08-12 00:09:22 on dist-test-slave-6nmv"
server_key: "ba179665f4050720f185ecae1899fffa"
server_key_iv: "16a43ddd29dbdb0d67fbc6144fd53131"
server_key_version: "encryptionkey@0"
I20260812 00:09:22.374845 12075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "f69ee21a299f4b4a89d92676248e0a82"
format_stamp: "Formatted at 2026-08-12 00:09:22 on dist-test-slave-6nmv"
server_key: "ba179665f4050720f185ecae1899fffa"
server_key_iv: "16a43ddd29dbdb0d67fbc6144fd53131"
server_key_version: "encryptionkey@0"
I20260812 00:09:22.376106 12075 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:09:22.376772 12093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:22.376943 12075 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:09:22.377025 12075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "f69ee21a299f4b4a89d92676248e0a82"
format_stamp: "Formatted at 2026-08-12 00:09:22 on dist-test-slave-6nmv"
server_key: "ba179665f4050720f185ecae1899fffa"
server_key_iv: "16a43ddd29dbdb0d67fbc6144fd53131"
server_key_version: "encryptionkey@0"
I20260812 00:09:22.377076 12075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:22.379976 12075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:22.381711 12075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:22.381853 12075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:22.385394 12075 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40693
I20260812 00:09:22.385486 12151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40693 every 8 connection(s)
I20260812 00:09:22.385762 12075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:22.386775 12152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:22.388863 12152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82: Bootstrap starting.
I20260812 00:09:22.389408 12152 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:22.389703 12152 log.cc:824] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:22.390404 12152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82: No bootstrap required, opened a new log
I20260812 00:09:22.391868 12152 raft_consensus.cc:348] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f69ee21a299f4b4a89d92676248e0a82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40693 } }
I20260812 00:09:22.392019 12152 raft_consensus.cc:374] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:22.392066 12152 raft_consensus.cc:729] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f69ee21a299f4b4a89d92676248e0a82, State: Initialized, Role: FOLLOWER
I20260812 00:09:22.392228 12152 consensus_queue.cc:260] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f69ee21a299f4b4a89d92676248e0a82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40693 } }
I20260812 00:09:22.392326 12152 raft_consensus.cc:388] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:22.392369 12152 raft_consensus.cc:482] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:22.392427 12152 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:22.392933 12152 raft_consensus.cc:504] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f69ee21a299f4b4a89d92676248e0a82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40693 } }
I20260812 00:09:22.393054 12152 leader_election.cc:302] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f69ee21a299f4b4a89d92676248e0a82; no voters:
I20260812 00:09:22.393231 12152 leader_election.cc:288] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:22.393276 12155 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:22.393448 12155 raft_consensus.cc:686] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [term 1 LEADER]: Becoming Leader. State: Replica: f69ee21a299f4b4a89d92676248e0a82, State: Running, Role: LEADER
I20260812 00:09:22.393471 12152 sys_catalog.cc:564] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:22.393530 12155 consensus_queue.cc:237] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f69ee21a299f4b4a89d92676248e0a82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40693 } }
I20260812 00:09:22.393903 12157 sys_catalog.cc:455] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f69ee21a299f4b4a89d92676248e0a82. Latest consensus state: current_term: 1 leader_uuid: "f69ee21a299f4b4a89d92676248e0a82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f69ee21a299f4b4a89d92676248e0a82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40693 } } }
I20260812 00:09:22.393997 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 12075
I20260812 00:09:22.394084 12156 sys_catalog.cc:455] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f69ee21a299f4b4a89d92676248e0a82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f69ee21a299f4b4a89d92676248e0a82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40693 } } }
I20260812 00:09:22.394122 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:22.394137 12156 sys_catalog.cc:458] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:22.394351 19693 external_mini_cluster.cc:1428] Setting key 903dbc4fde2f2d0adbafc68432b3d5d0
I20260812 00:09:22.394004 12157 sys_catalog.cc:458] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:22.394754 12163 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:22.395502 12163 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:22.396929 12175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:22.394910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:44475 (local address 127.0.0.1:40693)
0812 00:09:22.395153 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:22.395163 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:22.395193 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:09:22.395300 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:22.395307 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:22.395335 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:22.395461 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:22.396354 (+ 893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:22.396357 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:22.396357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:22.396362 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:22.396400 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:22.396414 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:22.396484 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:22.396743 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 00:09:22.396788 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":68,"threads_started":1}
I20260812 00:09:22.397878 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:22.400148 12175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:22.399119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:52917 (local address 127.0.0.1:40693)
0812 00:09:22.399148 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:22.399150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:22.399269 (+ 119us) server_negotiation.cc:407] Connection header received
0812 00:09:22.399335 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:22.399336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:22.399351 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:22.399401 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:22.399933 (+ 532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:22.399934 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:22.399935 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:22.399940 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:22.399952 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:22.399956 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:22.400017 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:22.400069 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 00:09:22.400084 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 00:09:22.405596 12163 catalog_manager.cc:1347] Generated new cluster ID: a89a6904ad204c0ab459da1606a7fae1
I20260812 00:09:22.405655 12163 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:22.421713 12163 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:22.421914 12163 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:22.429975 12163 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f69ee21a299f4b4a89d92676248e0a82: Generated new TSK 0
I20260812 00:09:22.430161 12163 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:22.435806 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 12075
2026-08-12T00:09:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1335 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:22 dist-test-slave-6nmv krb5kdc[12190](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:22 dist-test-slave-6nmv krb5kdc[12190](info): set up 2 sockets
Aug 12 00:09:22 dist-test-slave-6nmv krb5kdc[12190](info): commencing operation
krb5kdc: starting...
W20260812 00:09:23.518591 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:23 dist-test-slave-6nmv krb5kdc[12190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:09:23.628672 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:43145
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:36563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:43145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:23.705360 12207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:23.705557 12207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:23.705580 12207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:23.706668 12207 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:23.706724 12207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:23.706737 12207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:23.706749 12207 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:23.706759 12207 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:23.708000 12207 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:36563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:43145
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:43145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:23.708168 12207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:23.708312 12207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:23.712674 12213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:23.712689 12212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:23.712728 12215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:23.712952 12207 server_base.cc:1034] running on GCE node
I20260812 00:09:23.713167 12207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:23.713449 12207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:23.714603 12207 hybrid_clock.cc:648] HybridClock initialized: now 1786493363714585 us; error 49 us; skew 500 ppm
Aug 12 00:09:23 dist-test-slave-6nmv krb5kdc[12190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493363, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:23.717005 12207 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:09:23.717442 12207 webserver.cc:460] Webserver started at http://127.19.59.126:40931/ using document root <none> and password file <none>
I20260812 00:09:23.717653 12207 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:23.717715 12207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:23.717885 12207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:23.718914 12207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "6880e7a7c5a54002af8a37a1a4351ccf"
format_stamp: "Formatted at 2026-08-12 00:09:23 on dist-test-slave-6nmv"
server_key: "0f669f9c821974c3288947aef13574c1"
server_key_iv: "dbd5763d5279c1d394b1e10f7f727f98"
server_key_version: "encryptionkey@0"
I20260812 00:09:23.719272 12207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "6880e7a7c5a54002af8a37a1a4351ccf"
format_stamp: "Formatted at 2026-08-12 00:09:23 on dist-test-slave-6nmv"
server_key: "0f669f9c821974c3288947aef13574c1"
server_key_iv: "dbd5763d5279c1d394b1e10f7f727f98"
server_key_version: "encryptionkey@0"
I20260812 00:09:23.720569 12207 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:09:23.721257 12222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:23.721421 12207 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:23.721519 12207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "6880e7a7c5a54002af8a37a1a4351ccf"
format_stamp: "Formatted at 2026-08-12 00:09:23 on dist-test-slave-6nmv"
server_key: "0f669f9c821974c3288947aef13574c1"
server_key_iv: "dbd5763d5279c1d394b1e10f7f727f98"
server_key_version: "encryptionkey@0"
I20260812 00:09:23.721599 12207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:23.735762 12207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:23.738029 12207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:23.738173 12207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:23.741720 12207 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:43145
I20260812 00:09:23.741752 12278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:43145 every 8 connection(s)
I20260812 00:09:23.742143 12207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:23.742748 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 12207
I20260812 00:09:23.742871 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:23.743002 12279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:23.743080 19693 external_mini_cluster.cc:1428] Setting key 254cb5b6a8335ee902a36d84db1f5eeb
I20260812 00:09:23.746126 12279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf: Bootstrap starting.
I20260812 00:09:23.746793 12279 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:23.747044 12279 log.cc:824] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:23.747730 12279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf: No bootstrap required, opened a new log
Aug 12 00:09:23 dist-test-slave-6nmv krb5kdc[12190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:23.749656 12279 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6880e7a7c5a54002af8a37a1a4351ccf" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43145 } }
I20260812 00:09:23.749796 12279 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:23.749831 12279 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6880e7a7c5a54002af8a37a1a4351ccf, State: Initialized, Role: FOLLOWER
I20260812 00:09:23.750012 12279 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6880e7a7c5a54002af8a37a1a4351ccf" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43145 } }
I20260812 00:09:23.750106 12279 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:23.750147 12279 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:23.750193 12279 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:23.750653 12279 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6880e7a7c5a54002af8a37a1a4351ccf" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43145 } }
I20260812 00:09:23.750777 12279 leader_election.cc:302] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6880e7a7c5a54002af8a37a1a4351ccf; no voters:
I20260812 00:09:23.750932 12279 leader_election.cc:288] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:23.750995 12284 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:23.751148 12284 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [term 1 LEADER]: Becoming Leader. State: Replica: 6880e7a7c5a54002af8a37a1a4351ccf, State: Running, Role: LEADER
I20260812 00:09:23.751191 12279 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:23.751242 12284 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6880e7a7c5a54002af8a37a1a4351ccf" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43145 } }
I20260812 00:09:23.751566 12285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6880e7a7c5a54002af8a37a1a4351ccf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6880e7a7c5a54002af8a37a1a4351ccf" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43145 } } }
I20260812 00:09:23.751704 12285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:23.751919 12293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:23.752405 12293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:23.751879 12286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6880e7a7c5a54002af8a37a1a4351ccf. Latest consensus state: current_term: 1 leader_uuid: "6880e7a7c5a54002af8a37a1a4351ccf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6880e7a7c5a54002af8a37a1a4351ccf" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43145 } } }
I20260812 00:09:23.753093 12286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:23.754251 12282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:23.743586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40429 (local address 127.19.59.126:43145)
0812 00:09:23.743741 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:23.743748 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:23.743770 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:09:23.744311 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:23.744317 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:23.744358 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:23.744456 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:23.745267 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:23.746303 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:23.747155 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:23.747658 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:23.747770 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:23.750338 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:23.750341 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:23.750342 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:23.750352 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:23.752557 (+ 2205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:23.753054 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:23.753057 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:23.753058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:23.753150 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:23.753414 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:23.753415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:23.753416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:23.753648 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:23.753793 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:23.753949 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 00:09:23.754044 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":79,"threads_started":1}
I20260812 00:09:23.754534 12293 catalog_manager.cc:1347] Generated new cluster ID: 9e2557fbac8d434d80e069134081fba4
I20260812 00:09:23.754585 12293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:23.755193 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:23.763257 12282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:23.756558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50369 (local address 127.19.59.126:43145)
0812 00:09:23.756590 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:23.756591 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:23.756695 (+ 104us) server_negotiation.cc:407] Connection header received
0812 00:09:23.756719 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:23.756720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:23.756728 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:23.756792 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:23.757296 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:23.758113 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:23.759032 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:23.759363 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:23.759435 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:23.760675 (+ 1240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:23.760677 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:23.760677 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:23.760683 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:23.762166 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:23.762532 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:23.762533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:23.762534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:23.762589 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:23.762801 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:23.762801 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:23.762802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:23.762919 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:23.763012 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:23.763121 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 00:09:23.763178 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":10,"server-negotiator.queue_time_us":17}
I20260812 00:09:23.771899 12293 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:23.772409 12293 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:23.776896 12293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6880e7a7c5a54002af8a37a1a4351ccf: Generated new TSK 0
I20260812 00:09:23.777073 12293 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:23.783565 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 12207
W20260812 00:09:23.791800 12188 connection.cc:535] client connection to 127.19.59.126:43145 recv error: Network error: failed to read from TLS socket (remote: 127.19.59.126:43145): Connection reset by peer (error 104)
2026-08-12T00:09:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1348 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:23 dist-test-slave-6nmv krb5kdc[12314](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:23 dist-test-slave-6nmv krb5kdc[12314](info): set up 2 sockets
Aug 12 00:09:23 dist-test-slave-6nmv krb5kdc[12314](info): commencing operation
krb5kdc: starting...
W20260812 00:09:24.843786 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:24 dist-test-slave-6nmv krb5kdc[12314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:09:24.958626 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:35283
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:35117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:35283
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:25.031404 12328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:25.031592 12328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:25.031643 12328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:25.032826 12328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:25.032878 12328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:25.032891 12328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:25.032903 12328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:25.032948 12328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:25.034257 12328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:35117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:35283
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:35283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:25.034476 12328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:25.034682 12328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:25.039364 12333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:25.039426 12334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:25.039364 12328 server_base.cc:1034] running on GCE node
W20260812 00:09:25.039420 12336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:25.039966 12328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:25.040274 12328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:25.041441 12328 hybrid_clock.cc:648] HybridClock initialized: now 1786493365041419 us; error 35 us; skew 500 ppm
Aug 12 00:09:25 dist-test-slave-6nmv krb5kdc[12314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493365, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:25.043766 12328 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:09:25.044166 12328 webserver.cc:460] Webserver started at http://127.19.59.126:42941/ using document root <none> and password file <none>
I20260812 00:09:25.044410 12328 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:25.044478 12328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:25.044639 12328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:25.045665 12328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "be46fb80a78e46248cefbe1c057ec9f7"
format_stamp: "Formatted at 2026-08-12 00:09:25 on dist-test-slave-6nmv"
server_key: "c1c5949a4748cf7bbcfcabd0eb62fe98"
server_key_iv: "700cc164e8c4a4ffc17289356a0a6b95"
server_key_version: "encryptionkey@0"
I20260812 00:09:25.046066 12328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "be46fb80a78e46248cefbe1c057ec9f7"
format_stamp: "Formatted at 2026-08-12 00:09:25 on dist-test-slave-6nmv"
server_key: "c1c5949a4748cf7bbcfcabd0eb62fe98"
server_key_iv: "700cc164e8c4a4ffc17289356a0a6b95"
server_key_version: "encryptionkey@0"
I20260812 00:09:25.047328 12328 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:09:25.048020 12343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:25.048195 12328 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:09:25.048300 12328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "be46fb80a78e46248cefbe1c057ec9f7"
format_stamp: "Formatted at 2026-08-12 00:09:25 on dist-test-slave-6nmv"
server_key: "c1c5949a4748cf7bbcfcabd0eb62fe98"
server_key_iv: "700cc164e8c4a4ffc17289356a0a6b95"
server_key_version: "encryptionkey@0"
I20260812 00:09:25.048373 12328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:25.068429 12328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:25.070379 12328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:25.070549 12328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:25.074854 12328 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:35283
I20260812 00:09:25.074885 12400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:35283 every 8 connection(s)
I20260812 00:09:25.075234 12328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:25.076100 12401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:25.078274 12401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7: Bootstrap starting.
I20260812 00:09:25.078827 12401 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:25.079099 12401 log.cc:824] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:25.079775 12401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7: No bootstrap required, opened a new log
I20260812 00:09:25.081157 12401 raft_consensus.cc:348] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be46fb80a78e46248cefbe1c057ec9f7" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35283 } }
I20260812 00:09:25.081307 12401 raft_consensus.cc:374] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:25.081329 12401 raft_consensus.cc:729] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be46fb80a78e46248cefbe1c057ec9f7, State: Initialized, Role: FOLLOWER
I20260812 00:09:25.081487 12401 consensus_queue.cc:260] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be46fb80a78e46248cefbe1c057ec9f7" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35283 } }
I20260812 00:09:25.081547 12401 raft_consensus.cc:388] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:25.081574 12401 raft_consensus.cc:482] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:25.081622 12401 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:25.082527 12401 raft_consensus.cc:504] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be46fb80a78e46248cefbe1c057ec9f7" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35283 } }
I20260812 00:09:25.082655 12401 leader_election.cc:302] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be46fb80a78e46248cefbe1c057ec9f7; no voters:
I20260812 00:09:25.082676 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 12328
I20260812 00:09:25.082777 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:25.082819 12401 leader_election.cc:288] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:25.082870 12404 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:25.083016 19693 external_mini_cluster.cc:1428] Setting key ebefbeb06d62e55196d681fac148d4b2
I20260812 00:09:25.083040 12404 raft_consensus.cc:686] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [term 1 LEADER]: Becoming Leader. State: Replica: be46fb80a78e46248cefbe1c057ec9f7, State: Running, Role: LEADER
I20260812 00:09:25.083086 12401 sys_catalog.cc:564] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:25.083129 12404 consensus_queue.cc:237] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be46fb80a78e46248cefbe1c057ec9f7" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35283 } }
I20260812 00:09:25.083513 12405 sys_catalog.cc:455] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be46fb80a78e46248cefbe1c057ec9f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be46fb80a78e46248cefbe1c057ec9f7" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35283 } } }
I20260812 00:09:25.083612 12405 sys_catalog.cc:458] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:25.083838 12406 sys_catalog.cc:455] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be46fb80a78e46248cefbe1c057ec9f7. Latest consensus state: current_term: 1 leader_uuid: "be46fb80a78e46248cefbe1c057ec9f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be46fb80a78e46248cefbe1c057ec9f7" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35283 } } }
I20260812 00:09:25.083933 12406 sys_catalog.cc:458] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:25.084051 12413 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:25.084606 12413 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:25.088681 12414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:25.083670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37939 (local address 127.19.59.126:35283)
0812 00:09:25.083835 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:25.083845 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:25.083883 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:09:25.083992 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:25.083998 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:25.084054 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:25.084257 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:25.084520 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:25.085974 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:25.086726 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:25.087310 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:25.087420 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:25.088053 (+ 633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:25.088056 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:25.088057 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:25.088253 (+ 196us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:25.088286 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:25.088298 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:25.088382 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:25.088447 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 00:09:25.088474 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":61,"threads_started":1}
I20260812 00:09:25.089270 12413 catalog_manager.cc:1347] Generated new cluster ID: a452dce4a11349ac8c7f6f98303bccab
I20260812 00:09:25.089352 12413 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:25.089689 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:25.094578 12414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:25.091210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40257 (local address 127.19.59.126:35283)
0812 00:09:25.091241 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:25.091242 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:25.091330 (+ 88us) server_negotiation.cc:407] Connection header received
0812 00:09:25.091381 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:25.091382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:25.091390 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:25.091447 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:25.091561 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:25.092261 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:25.093284 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:25.093572 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:25.093629 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:25.094322 (+ 693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:25.094323 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:25.094323 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:25.094327 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:25.094340 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:25.094344 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:25.094399 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:25.094499 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 00:09:25.094511 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 00:09:25.099386 12413 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:25.100055 12413 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:25.102376 12413 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be46fb80a78e46248cefbe1c057ec9f7: Generated new TSK 0
I20260812 00:09:25.102528 12413 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:25.108685 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 12328
W20260812 00:09:25.118011 12312 connection.cc:535] client connection to 127.19.59.126:35283 recv error: Network error: failed to read from TLS socket (remote: 127.19.59.126:35283): Connection reset by peer (error 104)
2026-08-12T00:09:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1326 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:25 dist-test-slave-6nmv krb5kdc[12432](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:25 dist-test-slave-6nmv krb5kdc[12432](info): set up 2 sockets
Aug 12 00:09:25 dist-test-slave-6nmv krb5kdc[12432](info): commencing operation
krb5kdc: starting...
W20260812 00:09:26.163782 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:26 dist-test-slave-6nmv krb5kdc[12432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:09:26.274030 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:43785
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:42095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:43785
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:26.351366 12447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:26.351622 12447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:26.351665 12447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:26.352725 12447 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:26.352763 12447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:26.352777 12447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:26.352789 12447 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:26.352802 12447 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:26.354074 12447 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:42095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:43785
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:43785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:26.354231 12447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:26.354369 12447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:26.358857 12455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:26.358866 12453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:26.358927 12447 server_base.cc:1034] running on GCE node
W20260812 00:09:26.358843 12452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:26.359207 12447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:26.359472 12447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:26.360627 12447 hybrid_clock.cc:648] HybridClock initialized: now 1786493366360615 us; error 25 us; skew 500 ppm
Aug 12 00:09:26 dist-test-slave-6nmv krb5kdc[12432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493366, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:26.367515 12447 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:09:26.367889 12447 webserver.cc:460] Webserver started at http://127.19.59.126:33721/ using document root <none> and password file <none>
I20260812 00:09:26.368124 12447 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:26.368165 12447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:26.368242 12447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:26.369091 12447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "cf1a697b110b45debd7e2c6aeb76d4fd"
format_stamp: "Formatted at 2026-08-12 00:09:26 on dist-test-slave-6nmv"
server_key: "524baf6a94d4e87c9d2dc3d2f6ca3822"
server_key_iv: "932bbc4089c707eddfd89a47bb0a9a81"
server_key_version: "encryptionkey@0"
I20260812 00:09:26.369347 12447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "cf1a697b110b45debd7e2c6aeb76d4fd"
format_stamp: "Formatted at 2026-08-12 00:09:26 on dist-test-slave-6nmv"
server_key: "524baf6a94d4e87c9d2dc3d2f6ca3822"
server_key_iv: "932bbc4089c707eddfd89a47bb0a9a81"
server_key_version: "encryptionkey@0"
I20260812 00:09:26.370467 12447 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:09:26.371096 12463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:26.371265 12447 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:09:26.371356 12447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "cf1a697b110b45debd7e2c6aeb76d4fd"
format_stamp: "Formatted at 2026-08-12 00:09:26 on dist-test-slave-6nmv"
server_key: "524baf6a94d4e87c9d2dc3d2f6ca3822"
server_key_iv: "932bbc4089c707eddfd89a47bb0a9a81"
server_key_version: "encryptionkey@0"
I20260812 00:09:26.371435 12447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:26.374325 12447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:26.375957 12447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:26.376116 12447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:26.379709 12447 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:43785
I20260812 00:09:26.379733 12526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:43785 every 8 connection(s)
I20260812 00:09:26.379995 12447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:26.380859 12527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:26.382769 12527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd: Bootstrap starting.
I20260812 00:09:26.383212 12527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:26.383421 12527 log.cc:824] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:26.384038 12527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd: No bootstrap required, opened a new log
I20260812 00:09:26.385383 12527 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf1a697b110b45debd7e2c6aeb76d4fd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43785 } }
I20260812 00:09:26.385512 12527 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:26.385535 12527 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf1a697b110b45debd7e2c6aeb76d4fd, State: Initialized, Role: FOLLOWER
I20260812 00:09:26.385658 12527 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf1a697b110b45debd7e2c6aeb76d4fd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43785 } }
I20260812 00:09:26.385735 12527 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:26.385831 12527 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:26.385895 12527 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:26.386626 12527 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf1a697b110b45debd7e2c6aeb76d4fd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43785 } }
I20260812 00:09:26.386701 12527 leader_election.cc:302] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf1a697b110b45debd7e2c6aeb76d4fd; no voters:
I20260812 00:09:26.386806 12527 leader_election.cc:288] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:26.386861 12530 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:26.387008 12530 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [term 1 LEADER]: Becoming Leader. State: Replica: cf1a697b110b45debd7e2c6aeb76d4fd, State: Running, Role: LEADER
I20260812 00:09:26.387027 12527 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:26.387084 12530 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf1a697b110b45debd7e2c6aeb76d4fd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43785 } }
I20260812 00:09:26.387392 12532 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf1a697b110b45debd7e2c6aeb76d4fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf1a697b110b45debd7e2c6aeb76d4fd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43785 } } }
I20260812 00:09:26.387396 12533 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf1a697b110b45debd7e2c6aeb76d4fd. Latest consensus state: current_term: 1 leader_uuid: "cf1a697b110b45debd7e2c6aeb76d4fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf1a697b110b45debd7e2c6aeb76d4fd" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43785 } } }
I20260812 00:09:26.387482 12532 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:26.387487 12533 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:26.387703 12541 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:26.388335 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 12447
I20260812 00:09:26.388459 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:26.388660 19693 external_mini_cluster.cc:1428] Setting key 78618540befec256b707e9f8dce01208
I20260812 00:09:26.388165 12541 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:26.390225 12541 catalog_manager.cc:1347] Generated new cluster ID: 09c4affdb5c2408ebaec71cc89774611
I20260812 00:09:26.390272 12541 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:26.390635 12553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:26.389037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52557 (local address 127.19.59.126:43785)
0812 00:09:26.389426 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:26.389432 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:26.389451 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:09:26.389522 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:26.389526 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:26.389545 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:26.389671 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:26.390262 (+ 591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:26.390265 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:26.390265 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:26.390270 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:26.390311 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:26.390324 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:26.390387 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:26.390447 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 00:09:26.390489 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":67,"threads_started":1}
I20260812 00:09:26.394234 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:26.396695 12553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:26.395797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41311 (local address 127.19.59.126:43785)
0812 00:09:26.395828 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:26.395830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:26.395927 (+ 97us) server_negotiation.cc:407] Connection header received
0812 00:09:26.395952 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:26.395953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:26.395957 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:26.396027 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:26.396516 (+ 489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:26.396517 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:26.396518 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:26.396521 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:26.396534 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:26.396537 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:26.396594 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:26.396633 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 00:09:26.396644 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 00:09:26.403828 12541 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:26.403971 12541 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:26.408281 12541 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf1a697b110b45debd7e2c6aeb76d4fd: Generated new TSK 0
I20260812 00:09:26.408428 12541 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:26.412418 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 12447
2026-08-12T00:09:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1301 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:26 dist-test-slave-6nmv krb5kdc[12563](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:26 dist-test-slave-6nmv krb5kdc[12563](info): set up 2 sockets
Aug 12 00:09:26 dist-test-slave-6nmv krb5kdc[12563](info): commencing operation
krb5kdc: starting...
W20260812 00:09:27.479712 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:27 dist-test-slave-6nmv krb5kdc[12563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493367, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:09:27.590255 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:35521
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:35521
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:27.665539 12578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:27.665730 12578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:27.665753 12578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:27.666911 12578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:27.666954 12578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:27.666970 12578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:27.667006 12578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:27.667035 12578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:27.668465 12578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:35521
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:35521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:27.668695 12578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:27.668902 12578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:27.673801 12584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:27.673853 12587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:27.673859 12578 server_base.cc:1034] running on GCE node
W20260812 00:09:27.673887 12585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:27.674345 12578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:27.674574 12578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:27.675709 12578 hybrid_clock.cc:648] HybridClock initialized: now 1786493367675698 us; error 27 us; skew 500 ppm
Aug 12 00:09:27 dist-test-slave-6nmv krb5kdc[12563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493367, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:27.678097 12578 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:09:27.678560 12578 webserver.cc:460] Webserver started at http://127.19.59.126:34869/ using document root <none> and password file <none>
I20260812 00:09:27.678787 12578 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:27.678851 12578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:27.679005 12578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:27.679921 12578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "46274f882d4345f59d2adaa60231b530"
format_stamp: "Formatted at 2026-08-12 00:09:27 on dist-test-slave-6nmv"
server_key: "2737d46d45ea1181e7ed01e5d14d1e8b"
server_key_iv: "a0fa2c34caa177e4931da662b945d7f2"
server_key_version: "encryptionkey@0"
I20260812 00:09:27.680269 12578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "46274f882d4345f59d2adaa60231b530"
format_stamp: "Formatted at 2026-08-12 00:09:27 on dist-test-slave-6nmv"
server_key: "2737d46d45ea1181e7ed01e5d14d1e8b"
server_key_iv: "a0fa2c34caa177e4931da662b945d7f2"
server_key_version: "encryptionkey@0"
I20260812 00:09:27.681470 12578 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:09:27.682188 12596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:27.682344 12578 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:27.682435 12578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "46274f882d4345f59d2adaa60231b530"
format_stamp: "Formatted at 2026-08-12 00:09:27 on dist-test-slave-6nmv"
server_key: "2737d46d45ea1181e7ed01e5d14d1e8b"
server_key_iv: "a0fa2c34caa177e4931da662b945d7f2"
server_key_version: "encryptionkey@0"
I20260812 00:09:27.682518 12578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:27.704016 12578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:27.705595 12578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:27.705757 12578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:27.709475 12578 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:35521
I20260812 00:09:27.709503 12653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:35521 every 8 connection(s)
I20260812 00:09:27.709796 12578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:27.710618 12654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:27.712661 12654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530: Bootstrap starting.
I20260812 00:09:27.713193 12654 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:27.713438 12654 log.cc:824] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:27.714071 12654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530: No bootstrap required, opened a new log
I20260812 00:09:27.714425 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 12578
I20260812 00:09:27.714524 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:27.714700 19693 external_mini_cluster.cc:1428] Setting key 0d1dfe476fc03babcdc72bcffb6734a1
I20260812 00:09:27.716325 12654 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46274f882d4345f59d2adaa60231b530" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35521 } }
I20260812 00:09:27.716511 12654 raft_consensus.cc:374] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:27.716544 12654 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46274f882d4345f59d2adaa60231b530, State: Initialized, Role: FOLLOWER
I20260812 00:09:27.716660 12654 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46274f882d4345f59d2adaa60231b530" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35521 } }
I20260812 00:09:27.716739 12654 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:27.716777 12654 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:27.716825 12654 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:27.717320 12654 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46274f882d4345f59d2adaa60231b530" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35521 } }
I20260812 00:09:27.717427 12654 leader_election.cc:302] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46274f882d4345f59d2adaa60231b530; no voters:
I20260812 00:09:27.717581 12654 leader_election.cc:288] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:27.717625 12659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:27.717772 12659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [term 1 LEADER]: Becoming Leader. State: Replica: 46274f882d4345f59d2adaa60231b530, State: Running, Role: LEADER
I20260812 00:09:27.717836 12654 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:27.719072 12659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46274f882d4345f59d2adaa60231b530" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35521 } }
W20260812 00:09:27.720112 12678 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 00:09:27.719635 12662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46274f882d4345f59d2adaa60231b530" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46274f882d4345f59d2adaa60231b530" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35521 } } }
I20260812 00:09:27.720216 12662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:27.719587 12661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46274f882d4345f59d2adaa60231b530. Latest consensus state: current_term: 1 leader_uuid: "46274f882d4345f59d2adaa60231b530" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46274f882d4345f59d2adaa60231b530" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 35521 } } }
I20260812 00:09:27.720368 12661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530 [sys.catalog]: This master's current role is: LEADER
W20260812 00:09:27.720492 12678 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:09:27.720600 12682 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:27.720791 12682 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 00:09:27 dist-test-slave-6nmv krb5kdc[12563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493367, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:27.722222 12682 catalog_manager.cc:1347] Generated new cluster ID: 06415c12e3724837910f25cf26054563
I20260812 00:09:27.722324 12682 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:27.726065 12658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:27.715146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48897 (local address 127.19.59.126:35521)
0812 00:09:27.715356 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:27.715362 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:27.715386 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:09:27.715844 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:27.715851 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:27.715894 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:27.716007 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:27.716805 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:27.718204 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:27.719196 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:27.719749 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:27.719839 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:27.722596 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:27.722600 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:27.722601 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:27.722611 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:27.724335 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:27.724653 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:27.724656 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:27.724656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:27.724734 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:27.724873 (+ 139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:27.724873 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:27.724874 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:27.725112 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:27.725229 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:27.725715 (+ 486us) server_negotiation.cc:299] Negotiation successful
0812 00:09:27.725868 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":155,"thread_start_us":81,"threads_started":1}
I20260812 00:09:27.726774 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:27.737473 12658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:27.728110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38989 (local address 127.19.59.126:35521)
0812 00:09:27.728137 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:27.728139 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:27.729971 (+ 1832us) server_negotiation.cc:407] Connection header received
0812 00:09:27.730023 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:27.730024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:27.730032 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:27.730082 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:27.730634 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:27.731216 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:27.732134 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:27.732430 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:27.732486 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:27.733735 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:27.733736 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:27.733736 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:27.733742 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:27.736254 (+ 2512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:27.736735 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:27.736736 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:27.736736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:27.736789 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:27.737003 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:27.737005 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:27.737005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:27.737111 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:27.737186 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:27.737330 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 00:09:27.737394 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 00:09:27.764581 12682 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:27.765038 12682 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:27.769713 12682 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 46274f882d4345f59d2adaa60231b530: Generated new TSK 0
I20260812 00:09:27.769879 12682 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:27.777688 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 12578
2026-08-12T00:09:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1366 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:27 dist-test-slave-6nmv krb5kdc[12691](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:27 dist-test-slave-6nmv krb5kdc[12691](info): set up 2 sockets
Aug 12 00:09:27 dist-test-slave-6nmv krb5kdc[12691](info): commencing operation
krb5kdc: starting...
W20260812 00:09:28.824002 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:28 dist-test-slave-6nmv krb5kdc[12691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:09:28.938347 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:36693
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:36693
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:29.020604 12705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:29.020828 12705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:29.020852 12705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:29.022028 12705 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:29.022070 12705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:29.022084 12705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:29.022097 12705 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:29.022109 12705 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:29.023541 12705 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:36693
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:36693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:29.023764 12705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:29.023972 12705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:29.029008 12713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:29.029022 12710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:29.029023 12711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:29.029052 12705 server_base.cc:1034] running on GCE node
I20260812 00:09:29.029501 12705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:29.029791 12705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:29.030993 12705 hybrid_clock.cc:648] HybridClock initialized: now 1786493369030981 us; error 31 us; skew 500 ppm
Aug 12 00:09:29 dist-test-slave-6nmv krb5kdc[12691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493369, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:29.033640 12705 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:09:29.034140 12705 webserver.cc:460] Webserver started at http://127.19.59.126:35691/ using document root <none> and password file <none>
I20260812 00:09:29.034371 12705 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:29.034416 12705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:29.034578 12705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:29.035656 12705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "265c293406404ef393d628e980a72145"
format_stamp: "Formatted at 2026-08-12 00:09:29 on dist-test-slave-6nmv"
server_key: "473d2eb79b12955a06323f9d9e862982"
server_key_iv: "b9adb31096a7ffbcf4970666bed52b84"
server_key_version: "encryptionkey@0"
I20260812 00:09:29.036021 12705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "265c293406404ef393d628e980a72145"
format_stamp: "Formatted at 2026-08-12 00:09:29 on dist-test-slave-6nmv"
server_key: "473d2eb79b12955a06323f9d9e862982"
server_key_iv: "b9adb31096a7ffbcf4970666bed52b84"
server_key_version: "encryptionkey@0"
I20260812 00:09:29.037418 12705 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:09:29.038254 12720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:29.038445 12705 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:09:29.038517 12705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "265c293406404ef393d628e980a72145"
format_stamp: "Formatted at 2026-08-12 00:09:29 on dist-test-slave-6nmv"
server_key: "473d2eb79b12955a06323f9d9e862982"
server_key_iv: "b9adb31096a7ffbcf4970666bed52b84"
server_key_version: "encryptionkey@0"
I20260812 00:09:29.038607 12705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:29.058689 12705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:29.060712 12705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:29.060860 12705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:29.065025 12705 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:36693
I20260812 00:09:29.065075 12781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:36693 every 8 connection(s)
I20260812 00:09:29.065419 12705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:29.066278 12782 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:29.068526 12782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145: Bootstrap starting.
I20260812 00:09:29.069082 12782 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:29.069391 12782 log.cc:824] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:29.070045 12782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145: No bootstrap required, opened a new log
I20260812 00:09:29.071439 12782 raft_consensus.cc:348] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "265c293406404ef393d628e980a72145" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36693 } }
I20260812 00:09:29.071588 12782 raft_consensus.cc:374] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:29.071676 12782 raft_consensus.cc:729] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 265c293406404ef393d628e980a72145, State: Initialized, Role: FOLLOWER
I20260812 00:09:29.071851 12782 consensus_queue.cc:260] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "265c293406404ef393d628e980a72145" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36693 } }
I20260812 00:09:29.071950 12782 raft_consensus.cc:388] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:29.072002 12782 raft_consensus.cc:482] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:29.072052 12782 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:29.072860 12782 raft_consensus.cc:504] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "265c293406404ef393d628e980a72145" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36693 } }
I20260812 00:09:29.072992 12782 leader_election.cc:302] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 265c293406404ef393d628e980a72145; no voters:
I20260812 00:09:29.073168 12782 leader_election.cc:288] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:29.073195 12785 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:29.073365 12785 raft_consensus.cc:686] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [term 1 LEADER]: Becoming Leader. State: Replica: 265c293406404ef393d628e980a72145, State: Running, Role: LEADER
I20260812 00:09:29.073410 12782 sys_catalog.cc:564] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:29.073510 12785 consensus_queue.cc:237] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "265c293406404ef393d628e980a72145" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36693 } }
I20260812 00:09:29.073542 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 12705
I20260812 00:09:29.073657 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:29.073848 19693 external_mini_cluster.cc:1428] Setting key 6d17049db138bf702c1815b7b4ac03a8
I20260812 00:09:29.073866 12787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 265c293406404ef393d628e980a72145. Latest consensus state: current_term: 1 leader_uuid: "265c293406404ef393d628e980a72145" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "265c293406404ef393d628e980a72145" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36693 } } }
I20260812 00:09:29.073961 12787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:29.074115 12786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "265c293406404ef393d628e980a72145" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "265c293406404ef393d628e980a72145" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 36693 } } }
I20260812 00:09:29.074240 12786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145 [sys.catalog]: This master's current role is: LEADER
W20260812 00:09:29.075197 12805 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:09:29.075248 12805 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:09:29.075302 12792 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:29.075466 12792 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:29.076956 12792 catalog_manager.cc:1347] Generated new cluster ID: 3b218a53b2414f4e9b7d8d6736179658
I20260812 00:09:29.077005 12792 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:29.079365 12800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:29.074508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39083 (local address 127.19.59.126:36693)
0812 00:09:29.074705 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:29.074714 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:29.074752 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:09:29.074868 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:29.074907 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:29.074986 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:29.075154 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:29.075389 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:29.076604 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:29.077456 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:29.077915 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:29.078048 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:29.078719 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:29.078723 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:29.078723 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:29.078900 (+ 177us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:29.078929 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:29.078939 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:29.079024 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:29.079095 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:09:29.079155 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":93,"threads_started":1}
I20260812 00:09:29.080265 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:29.081712 12792 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:29.082324 12792 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:29.084699 12800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:29.081596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52231 (local address 127.19.59.126:36693)
0812 00:09:29.081640 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:29.081641 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:29.081790 (+ 149us) server_negotiation.cc:407] Connection header received
0812 00:09:29.081898 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:29.081899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:29.081908 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:29.081956 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:29.082108 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:29.082667 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:29.083561 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:29.083801 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:29.083859 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:29.084480 (+ 621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:29.084481 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:29.084482 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:29.084486 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:29.084497 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:29.084501 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:29.084545 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:29.084607 (+ 62us) server_negotiation.cc:299] Negotiation successful
0812 00:09:29.084640 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 00:09:29.087323 12792 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 265c293406404ef393d628e980a72145: Generated new TSK 0
I20260812 00:09:29.087471 12792 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:29.090085 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 12705
2026-08-12T00:09:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1313 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:29 dist-test-slave-6nmv krb5kdc[12819](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:29 dist-test-slave-6nmv krb5kdc[12819](info): set up 2 sockets
Aug 12 00:09:29 dist-test-slave-6nmv krb5kdc[12819](info): commencing operation
krb5kdc: starting...
W20260812 00:09:30.127549 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:30 dist-test-slave-6nmv krb5kdc[12819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493370, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:09:30.240399 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:37021
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:42395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:37021
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:30.316000 12834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:30.316226 12834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:30.316262 12834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:30.317366 12834 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:30.317430 12834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:30.317452 12834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:30.317473 12834 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:30.317500 12834 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:30.318912 12834 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:42395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:37021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:37021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:30.319177 12834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:30.319388 12834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:30.323830 12842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:30.323851 12844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:30.323935 12834 server_base.cc:1034] running on GCE node
W20260812 00:09:30.323849 12841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:30.324342 12834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:30.324666 12834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:30.325852 12834 hybrid_clock.cc:648] HybridClock initialized: now 1786493370325848 us; error 34 us; skew 500 ppm
Aug 12 00:09:30 dist-test-slave-6nmv krb5kdc[12819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493370, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:30.328143 12834 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:09:30.328534 12834 webserver.cc:460] Webserver started at http://127.19.59.126:45965/ using document root <none> and password file <none>
I20260812 00:09:30.328737 12834 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:30.328817 12834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:30.328961 12834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:30.330024 12834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "979a647f2fdf42e9bd6884159f73e504"
format_stamp: "Formatted at 2026-08-12 00:09:30 on dist-test-slave-6nmv"
server_key: "b61824c940ec0628d6a00a56355d12f4"
server_key_iv: "81b2688a4709feea279a1bc4990ef869"
server_key_version: "encryptionkey@0"
I20260812 00:09:30.330395 12834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "979a647f2fdf42e9bd6884159f73e504"
format_stamp: "Formatted at 2026-08-12 00:09:30 on dist-test-slave-6nmv"
server_key: "b61824c940ec0628d6a00a56355d12f4"
server_key_iv: "81b2688a4709feea279a1bc4990ef869"
server_key_version: "encryptionkey@0"
I20260812 00:09:30.331718 12834 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:09:30.332404 12851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:30.332576 12834 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:30.332671 12834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "979a647f2fdf42e9bd6884159f73e504"
format_stamp: "Formatted at 2026-08-12 00:09:30 on dist-test-slave-6nmv"
server_key: "b61824c940ec0628d6a00a56355d12f4"
server_key_iv: "81b2688a4709feea279a1bc4990ef869"
server_key_version: "encryptionkey@0"
I20260812 00:09:30.332749 12834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:30.335973 12834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:30.337617 12834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:30.337761 12834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:30.341305 12834 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:37021
I20260812 00:09:30.341356 12908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:37021 every 8 connection(s)
I20260812 00:09:30.341711 12834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:30.343060 12909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:30.344141 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 12834
I20260812 00:09:30.344235 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:30.344439 19693 external_mini_cluster.cc:1428] Setting key 9c320ee36ac62c02fc8a207c1f7738de
I20260812 00:09:30.345479 12909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504: Bootstrap starting.
I20260812 00:09:30.346210 12909 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:30.346487 12909 log.cc:824] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:30.347111 12912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:30.344903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47109 (local address 127.19.59.126:37021)
0812 00:09:30.345120 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:30.345129 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:30.345159 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:09:30.345678 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:30.345686 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:30.345716 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:30.345926 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:30.346631 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:30.346635 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:30.346636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:30.346640 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:30.346691 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:30.346705 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:30.346802 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:30.346876 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 00:09:30.346902 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":93,"threads_started":1}
I20260812 00:09:30.347332 12909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504: No bootstrap required, opened a new log
I20260812 00:09:30.348104 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:30.349684 12909 raft_consensus.cc:348] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979a647f2fdf42e9bd6884159f73e504" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 37021 } }
I20260812 00:09:30.349924 12909 raft_consensus.cc:374] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:09:30.349963 12909 raft_consensus.cc:729] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 979a647f2fdf42e9bd6884159f73e504, State: Initialized, Role: FOLLOWER
I20260812 00:09:30.350083 12909 consensus_queue.cc:260] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979a647f2fdf42e9bd6884159f73e504" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 37021 } }
I20260812 00:09:30.350186 12909 raft_consensus.cc:388] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:09:30.350225 12909 raft_consensus.cc:482] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:09:30.350286 12909 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:30.350814 12912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:30.349648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51865 (local address 127.19.59.126:37021)
0812 00:09:30.349694 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:30.349696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:30.349860 (+ 164us) server_negotiation.cc:407] Connection header received
0812 00:09:30.349988 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:30.349989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:30.349993 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:30.350051 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:30.350627 (+ 576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:30.350628 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:30.350629 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:09:30.350632 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:30.350645 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:09:30.350648 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:30.350698 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:30.350765 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 00:09:30.350776 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:09:30.351043 12909 raft_consensus.cc:504] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979a647f2fdf42e9bd6884159f73e504" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 37021 } }
I20260812 00:09:30.351167 12909 leader_election.cc:302] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 979a647f2fdf42e9bd6884159f73e504; no voters:
I20260812 00:09:30.351322 12909 leader_election.cc:288] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:09:30.351385 12920 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:30.351553 12920 raft_consensus.cc:686] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [term 1 LEADER]: Becoming Leader. State: Replica: 979a647f2fdf42e9bd6884159f73e504, State: Running, Role: LEADER
I20260812 00:09:30.351552 12909 sys_catalog.cc:564] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:30.351697 12920 consensus_queue.cc:237] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979a647f2fdf42e9bd6884159f73e504" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 37021 } }
I20260812 00:09:30.352094 12921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "979a647f2fdf42e9bd6884159f73e504" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979a647f2fdf42e9bd6884159f73e504" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 37021 } } }
I20260812 00:09:30.352216 12921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:30.352101 12922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 979a647f2fdf42e9bd6884159f73e504. Latest consensus state: current_term: 1 leader_uuid: "979a647f2fdf42e9bd6884159f73e504" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979a647f2fdf42e9bd6884159f73e504" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 37021 } } }
I20260812 00:09:30.352365 12922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:30.352787 12930 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:30.353292 12930 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:30.354931 12930 catalog_manager.cc:1347] Generated new cluster ID: b215d1c2245d4698803b08c40d0348c8
I20260812 00:09:30.354969 12930 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:30.381412 12930 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:30.381582 12930 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:30.384518 12930 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 979a647f2fdf42e9bd6884159f73e504: Generated new TSK 0
I20260812 00:09:30.384689 12930 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:30.386787 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 12834
2026-08-12T00:09:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1294 ms)
[----------] 18 tests from AuthTokenIssuingTest (23989 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:30 dist-test-slave-6nmv krb5kdc[12942](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:30 dist-test-slave-6nmv krb5kdc[12942](info): set up 2 sockets
Aug 12 00:09:30 dist-test-slave-6nmv krb5kdc[12942](info): commencing operation
krb5kdc: starting...
W20260812 00:09:31.437088 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.029s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:31 dist-test-slave-6nmv krb5kdc[12942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:09:31.552331 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:43527
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:45401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:43527,127.19.59.125:33511,127.19.59.124:34843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:31.628939 12957 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:09:31.629186 12957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:31.629217 12957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:31.629261 12957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:31.630386 12957 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:31.630450 12957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:31.630474 12957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:31.630496 12957 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:31.630524 12957 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:31.632000 12957 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:45401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:43527,127.19.59.125:33511,127.19.59.124:34843
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:43527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:31.632283 12957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:31.632509 12957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:31.637341 12962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:31.637377 12963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:31.637543 12957 server_base.cc:1034] running on GCE node
W20260812 00:09:31.637357 12965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:31.637930 12957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:31.638165 12957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:31.639302 12957 hybrid_clock.cc:648] HybridClock initialized: now 1786493371639289 us; error 28 us; skew 500 ppm
Aug 12 00:09:31 dist-test-slave-6nmv krb5kdc[12942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:31.647253 12957 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:09:31.647686 12957 webserver.cc:460] Webserver started at http://127.19.59.126:34741/ using document root <none> and password file <none>
I20260812 00:09:31.647867 12957 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:31.647909 12957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:31.647997 12957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:31.648947 12957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "fd0fe782ee734dc49c87270566a1a7cc"
format_stamp: "Formatted at 2026-08-12 00:09:31 on dist-test-slave-6nmv"
server_key: "2e31a6536251a71c939154afbb8d6322"
server_key_iv: "60de9268edfa8bed20804d853af4ab18"
server_key_version: "encryptionkey@0"
I20260812 00:09:31.649232 12957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "fd0fe782ee734dc49c87270566a1a7cc"
format_stamp: "Formatted at 2026-08-12 00:09:31 on dist-test-slave-6nmv"
server_key: "2e31a6536251a71c939154afbb8d6322"
server_key_iv: "60de9268edfa8bed20804d853af4ab18"
server_key_version: "encryptionkey@0"
I20260812 00:09:31.650499 12957 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:09:31.651168 12973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:31.651356 12957 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:31.651440 12957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "fd0fe782ee734dc49c87270566a1a7cc"
format_stamp: "Formatted at 2026-08-12 00:09:31 on dist-test-slave-6nmv"
server_key: "2e31a6536251a71c939154afbb8d6322"
server_key_iv: "60de9268edfa8bed20804d853af4ab18"
server_key_version: "encryptionkey@0"
I20260812 00:09:31.651502 12957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:31.666764 12957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:31.668531 12957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:31.668637 12957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:31.672444 12957 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:43527
I20260812 00:09:31.672521 13031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:43527 every 8 connection(s)
I20260812 00:09:31.672844 12957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:31.673838 13032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:31.675318 13032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:09:31.676849 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 12957
I20260812 00:09:31.676975 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:31.677204 19693 external_mini_cluster.cc:1428] Setting key 041b8c79487b8d36b9bb7e8591a74908
Aug 12 00:09:31 dist-test-slave-6nmv krb5kdc[12942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:31.686153 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.675967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:43527 (local address 127.0.0.1:38158)
0812 00:09:31.676139 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.676175 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:31.676607 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:31.676941 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:31.676944 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:31.677264 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:31.677434 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:31.677438 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.678929 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.678930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:31.680013 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:31.680016 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.680506 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.680507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:31.680585 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.681035 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:31.681044 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:31.682665 (+ 1621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:31.684687 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:31.684694 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:31.684695 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:31.684882 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:31.685152 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:31.685152 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:31.685153 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:31.685242 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:31.685695 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:31.685699 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:31.685749 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 00:09:31.685881 (+ 132us) client_negotiation.cc:240] Negotiation successful
0812 00:09:31.686007 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":96,"threads_started":1}
I20260812 00:09:31.686228 13035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.675988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38158 (local address 127.19.59.126:43527)
0812 00:09:31.676156 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:31.676168 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:31.676265 (+ 97us) server_negotiation.cc:407] Connection header received
0812 00:09:31.676769 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:31.676772 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:31.676795 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:31.676906 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:31.677537 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.678823 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.680105 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.680403 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.680492 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.682750 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:31.682758 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:31.682758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:31.682767 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:31.684601 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.684966 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.684969 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.684970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.685077 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.685309 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.685310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.685310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.685610 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:31.685715 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:31.685929 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 00:09:31.686100 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":132,"thread_start_us":98,"threads_started":1}
WARNING: no policy specified for kudu/127.19.59.125@KRBTEST.COM; defaulting to no policy
I20260812 00:09:31.686863 13032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:09:31.687166 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.687065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:33511 (local address 127.0.0.1:35824)
0812 00:09:31.687109 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.687148 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:33511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 00:09:31.687376 12978 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.59.125:33511: connect: Connection refused (error 111)
I20260812 00:09:31.687825 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.687727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:33511 (local address 127.0.0.1:35828)
0812 00:09:31.687776 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.687803 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:33511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 00:09:31.687925 13032 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.125:33511: Network error: Client connection negotiation failed: client connection to 127.19.59.125:33511: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.125.keytab.
Entry for principal kudu/127.19.59.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.125.keytab.
I20260812 00:09:31.702260 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.125:33511
--webserver_interface=127.19.59.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.125.keytab
--principal=kudu/127.19.59.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:45401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:43527,127.19.59.125:33511,127.19.59.124:34843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:09:31.737123 13032 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } attempt: 1
I20260812 00:09:31.737507 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.737388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:33511 (local address 127.0.0.1:35830)
0812 00:09:31.737440 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.737483 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:33511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 00:09:31.737865 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.737738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:33511 (local address 127.0.0.1:35834)
0812 00:09:31.737776 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.737798 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:33511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 00:09:31.737955 13032 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.125:33511: Network error: Client connection negotiation failed: client connection to 127.19.59.125:33511: connect: Connection refused (error 111)
W20260812 00:09:31.777155 13040 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:09:31.777380 13040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:31.777410 13040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:31.777467 13040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:31.778609 13040 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:31.778674 13040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:31.778698 13040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:31.778719 13040 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:31.778748 13040 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:31.780176 13040 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:45401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:43527,127.19.59.125:33511,127.19.59.124:34843
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.125.keytab
--principal=kudu/127.19.59.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.125:33511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.59.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:31.780455 13040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:31.780689 13040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:31.785323 13049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:31.785331 13046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:31.785600 13040 server_base.cc:1034] running on GCE node
W20260812 00:09:31.785343 13045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:31.785965 13040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:31.786267 13040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:31.787403 13040 hybrid_clock.cc:648] HybridClock initialized: now 1786493371787391 us; error 29 us; skew 500 ppm
Aug 12 00:09:31 dist-test-slave-6nmv krb5kdc[12942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:31.789755 13040 init.cc:377] Logged in from keytab as kudu/127.19.59.125@KRBTEST.COM (short username kudu)
I20260812 00:09:31.790237 13040 webserver.cc:460] Webserver started at http://127.19.59.125:34017/ using document root <none> and password file <none>
I20260812 00:09:31.790459 13040 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:31.790501 13040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:31.790633 13040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:31.791627 13040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/data/instance:
uuid: "1d8f88d3fa594e5db9acc58ed3643164"
format_stamp: "Formatted at 2026-08-12 00:09:31 on dist-test-slave-6nmv"
server_key: "bb84200b724d9d40019586d319431ef1"
server_key_iv: "bc0da910b6edce476339e0acc1821f4c"
server_key_version: "encryptionkey@0"
I20260812 00:09:31.791986 13040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/wal/instance:
uuid: "1d8f88d3fa594e5db9acc58ed3643164"
format_stamp: "Formatted at 2026-08-12 00:09:31 on dist-test-slave-6nmv"
server_key: "bb84200b724d9d40019586d319431ef1"
server_key_iv: "bc0da910b6edce476339e0acc1821f4c"
server_key_version: "encryptionkey@0"
I20260812 00:09:31.793293 13040 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:09:31.793992 13057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:31.794157 13040 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:31.794246 13040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/wal
uuid: "1d8f88d3fa594e5db9acc58ed3643164"
format_stamp: "Formatted at 2026-08-12 00:09:31 on dist-test-slave-6nmv"
server_key: "bb84200b724d9d40019586d319431ef1"
server_key_iv: "bc0da910b6edce476339e0acc1821f4c"
server_key_version: "encryptionkey@0"
I20260812 00:09:31.794328 13040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:31.801545 13040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:31.803128 13040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:31.803269 13040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:31.806092 13032 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } attempt: 2
I20260812 00:09:31.806515 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.806363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:33511 (local address 127.0.0.1:35846)
0812 00:09:31.806423 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.806454 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:33511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 00:09:31.806879 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.806761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:33511 (local address 127.0.0.1:35860)
0812 00:09:31.806809 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.806845 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:33511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 00:09:31.807027 13032 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.125:33511: Network error: Client connection negotiation failed: client connection to 127.19.59.125:33511: connect: Connection refused (error 111)
I20260812 00:09:31.807328 13040 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.125:33511
I20260812 00:09:31.807360 13118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.125:33511 every 8 connection(s)
I20260812 00:09:31.807662 13040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/data/info.pb
I20260812 00:09:31.808400 13119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:31.809800 13119 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:09:31 dist-test-slave-6nmv krb5kdc[12942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.125@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:31.816558 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 13040
I20260812 00:09:31.816684 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-1/wal/instance
I20260812 00:09:31.816910 19693 external_mini_cluster.cc:1428] Setting key 91ae0a215867b76a2bbfacf9336934db
I20260812 00:09:31.817961 13035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.810431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38164 (local address 127.19.59.126:43527)
0812 00:09:31.810487 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:31.810489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:31.810697 (+ 208us) server_negotiation.cc:407] Connection header received
0812 00:09:31.811106 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:31.811107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:31.811117 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:31.811164 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:31.811705 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.812154 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.813111 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.813295 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.813340 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.815274 (+ 1934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:31.815275 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:31.815275 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:31.815280 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:31.816556 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.817060 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.817061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.817062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.817132 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.817346 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.817347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.817347 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.817477 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:31.817542 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:31.817743 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 00:09:31.817847 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:09:31.818011 13121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.810422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:43527 (local address 127.0.0.1:38164)
0812 00:09:31.810596 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.810626 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:31.811035 (+ 409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:31.811223 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:31.811226 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:31.811433 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:31.811602 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:31.811605 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.812226 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.812226 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:31.813028 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:31.813030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.813368 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.813369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:31.813461 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.813974 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:31.813981 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:31.815201 (+ 1220us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:31.816666 (+ 1465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:31.816673 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:31.816675 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:31.816945 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:31.817197 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:31.817198 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:31.817198 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:31.817288 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:31.817536 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:31.817540 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:31.817632 (+ 92us) client_negotiation.cc:769] Sending connection context
0812 00:09:31.817702 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 00:09:31.817802 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":95,"threads_started":1}
I20260812 00:09:31.818476 13119 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:09:31 dist-test-slave-6nmv krb5kdc[12942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.125@KRBTEST.COM for kudu/127.19.59.125@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.59.124@KRBTEST.COM; defaulting to no policy
I20260812 00:09:31.826334 13121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.818728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:33511 (local address 127.0.0.1:35872)
0812 00:09:31.818771 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.818780 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:31.818815 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:31.819072 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:31.819073 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:31.819170 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:31.819216 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:31.819217 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.820414 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.820415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:31.820862 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:31.820863 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.821476 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.821476 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:31.821537 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.821942 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:31.821945 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:31.823336 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:31.825314 (+ 1978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:31.825315 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:31.825315 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:31.825472 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:31.825708 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:31.825709 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:31.825709 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:31.825761 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:31.826104 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:31.826105 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:31.826141 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:09:31.826199 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 00:09:31.826276 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 00:09:31.826498 13123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.818770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35872 (local address 127.19.59.125:33511)
0812 00:09:31.818919 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:31.818923 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:31.818948 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:09:31.818970 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:31.818972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:31.818986 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:31.819062 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:31.819282 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.820297 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.820946 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.821396 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.821476 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.823421 (+ 1945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:31.823430 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:31.823430 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:31.823438 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:31.825229 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.825553 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.825556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.825556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.825621 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.825844 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.825845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.825845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.826031 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:31.826117 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:31.826233 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 00:09:31.826339 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
I20260812 00:09:31.827081 13119 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:09:31.827333 13121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.827250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:34843 (local address 127.0.0.1:59180)
0812 00:09:31.827284 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.827320 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260812 00:09:31.827461 13063 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
I20260812 00:09:31.827832 13121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.827778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:34843 (local address 127.0.0.1:59192)
0812 00:09:31.827799 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.827819 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260812 00:09:31.828042 13119 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.124:34843: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.124.keytab.
Entry for principal kudu/127.19.59.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.124.keytab.
I20260812 00:09:31.842278 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.124:34843
--webserver_interface=127.19.59.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.124.keytab
--principal=kudu/127.19.59.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:45401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:43527,127.19.59.125:33511,127.19.59.124:34843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:09:31.877345 13119 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } attempt: 1
I20260812 00:09:31.877861 13121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.877684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:34843 (local address 127.0.0.1:59202)
0812 00:09:31.877756 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.877790 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 00:09:31.878225 13121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.878138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:34843 (local address 127.0.0.1:59212)
0812 00:09:31.878185 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.878210 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 00:09:31.878328 13119 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.124:34843: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
I20260812 00:09:31.898200 13032 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } attempt: 3
Aug 12 00:09:31 dist-test-slave-6nmv krb5kdc[12942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for kudu/127.19.59.125@KRBTEST.COM
I20260812 00:09:31.905501 13123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.898661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35880 (local address 127.19.59.125:33511)
0812 00:09:31.898735 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:31.898737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:31.898751 (+ 14us) server_negotiation.cc:407] Connection header received
0812 00:09:31.898798 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:31.898798 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:31.898809 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:31.898852 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:31.899285 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.899749 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.900801 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.900986 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.901032 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.902998 (+ 1966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:31.903000 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:31.903001 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:31.903010 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:31.904397 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.904738 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.904740 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.904740 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.904800 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.904994 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.904995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.904995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.905106 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:31.905173 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:31.905329 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 00:09:31.905403 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 00:09:31.905501 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.898603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:33511 (local address 127.0.0.1:35880)
0812 00:09:31.898665 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.898678 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:31.898726 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:31.898887 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:31.898888 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:31.899103 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:31.899199 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:31.899202 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.899836 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.899837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:31.900714 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:31.900717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.901056 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.901057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:31.901144 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.901581 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:31.901587 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:31.902909 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:31.904495 (+ 1586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:31.904496 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:31.904497 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:31.904667 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:31.904866 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:31.904867 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:31.904867 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:31.904931 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:31.905177 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:31.905178 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:31.905223 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 00:09:31.905303 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 00:09:31.905402 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 00:09:31.906066 13032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:09:31.906442 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.906335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:34843 (local address 127.0.0.1:59228)
0812 00:09:31.906385 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.906412 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 00:09:31.906823 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.906745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:34843 (local address 127.0.0.1:59240)
0812 00:09:31.906788 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.906809 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 00:09:31.906941 13032 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.124:34843: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
W20260812 00:09:31.923403 13126 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:09:31.923595 13126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:31.923614 13126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:31.923633 13126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:31.924580 13126 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:31.924618 13126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:31.924633 13126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:31.924646 13126 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:31.924659 13126 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:31.926088 13126 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:45401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:43527,127.19.59.125:33511,127.19.59.124:34843
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.124.keytab
--principal=kudu/127.19.59.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.124:34843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.59.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:31.926277 13126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:31.926512 13126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:31.930960 13131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:31.930999 13134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:31.931053 13132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:31.931267 13126 server_base.cc:1034] running on GCE node
I20260812 00:09:31.931519 13126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:31.931810 13126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:31.932973 13126 hybrid_clock.cc:648] HybridClock initialized: now 1786493371932964 us; error 39 us; skew 500 ppm
Aug 12 00:09:31 dist-test-slave-6nmv krb5kdc[12942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:31.935500 13126 init.cc:377] Logged in from keytab as kudu/127.19.59.124@KRBTEST.COM (short username kudu)
I20260812 00:09:31.935920 13126 webserver.cc:460] Webserver started at http://127.19.59.124:35125/ using document root <none> and password file <none>
I20260812 00:09:31.936147 13126 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:31.936215 13126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:31.936367 13126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:31.937376 13126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/data/instance:
uuid: "3a12342f891d4cfdb381bb726021b6bc"
format_stamp: "Formatted at 2026-08-12 00:09:31 on dist-test-slave-6nmv"
server_key: "95aee9df22882834a579bdee57d829b0"
server_key_iv: "117c08a73835cb4e91db93cbd882c796"
server_key_version: "encryptionkey@0"
I20260812 00:09:31.937728 13126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/wal/instance:
uuid: "3a12342f891d4cfdb381bb726021b6bc"
format_stamp: "Formatted at 2026-08-12 00:09:31 on dist-test-slave-6nmv"
server_key: "95aee9df22882834a579bdee57d829b0"
server_key_iv: "117c08a73835cb4e91db93cbd882c796"
server_key_version: "encryptionkey@0"
I20260812 00:09:31.938073 13032 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } attempt: 1
I20260812 00:09:31.938485 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.938348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:34843 (local address 127.0.0.1:59242)
0812 00:09:31.938418 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.938454 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 00:09:31.938823 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.938730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:34843 (local address 127.0.0.1:59246)
0812 00:09:31.938774 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.938799 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 00:09:31.938926 13032 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.124:34843: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
I20260812 00:09:31.939234 13126 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:09:31.939934 13142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:31.940089 13126 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:09:31.940191 13126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/wal
uuid: "3a12342f891d4cfdb381bb726021b6bc"
format_stamp: "Formatted at 2026-08-12 00:09:31 on dist-test-slave-6nmv"
server_key: "95aee9df22882834a579bdee57d829b0"
server_key_iv: "117c08a73835cb4e91db93cbd882c796"
server_key_version: "encryptionkey@0"
I20260812 00:09:31.940259 13126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:31.946457 13119 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } attempt: 2
I20260812 00:09:31.946815 13121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.946707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:34843 (local address 127.0.0.1:59262)
0812 00:09:31.946759 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.946791 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 00:09:31.947173 13121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.947067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:34843 (local address 127.0.0.1:59268)
0812 00:09:31.947124 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.947154 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260812 00:09:31.947260 13119 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.124:34843: Network error: Client connection negotiation failed: client connection to 127.19.59.124:34843: connect: Connection refused (error 111)
I20260812 00:09:31.958678 13126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:31.960338 13126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:31.960494 13126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:31.964314 13126 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.124:34843
I20260812 00:09:31.964363 13205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.124:34843 every 8 connection(s)
I20260812 00:09:31.964772 13126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/data/info.pb
I20260812 00:09:31.965758 13206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:31.966943 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 13126
I20260812 00:09:31.967052 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786493109864389-19693-0/minicluster-data/master-2/wal/instance
I20260812 00:09:31.967254 19693 external_mini_cluster.cc:1428] Setting key bf84c3f508a2021e8f5397c47df2039a
I20260812 00:09:31.967490 13206 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:09:31 dist-test-slave-6nmv krb5kdc[12942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.124@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
Aug 12 00:09:31 dist-test-slave-6nmv krb5kdc[12942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.124@KRBTEST.COM
I20260812 00:09:31.976828 13035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.968187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38176 (local address 127.19.59.126:43527)
0812 00:09:31.968235 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:31.968237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:31.968371 (+ 134us) server_negotiation.cc:407] Connection header received
0812 00:09:31.968542 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:31.968544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:31.968555 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:31.968614 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:31.969349 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.970100 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.971220 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.971439 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.971511 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.973909 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:31.973910 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:31.973911 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:31.973917 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:31.975377 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.975870 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.975871 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.975872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.975924 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.976202 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.976202 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.976202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.976298 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:31.976378 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:31.976659 (+ 281us) server_negotiation.cc:299] Negotiation successful
0812 00:09:31.976738 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:09:31.977030 13210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.968121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:43527 (local address 127.0.0.1:38176)
0812 00:09:31.968241 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.968275 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:31.968436 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:31.968652 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:31.968655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:31.969018 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:31.969267 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:31.969273 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.970169 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.970170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:31.971139 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:31.971141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.971549 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.971550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:31.971661 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.972168 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:31.972178 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:31.973812 (+ 1634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:31.975461 (+ 1649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:31.975468 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:31.975470 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:31.975794 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:31.975999 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:31.976000 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:31.976001 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:31.976132 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:31.976382 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:31.976389 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:31.976523 (+ 134us) client_negotiation.cc:769] Sending connection context
0812 00:09:31.976634 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 00:09:31.976779 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":62,"threads_started":1}
I20260812 00:09:31.977516 13206 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:09:31.977741 13209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.967735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59272 (local address 127.19.59.124:34843)
0812 00:09:31.967908 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:31.967916 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:31.967946 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:09:31.968439 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:31.968451 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:31.968485 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:31.968615 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:31.969380 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.970426 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.971400 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.971772 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.971848 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.974531 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:31.974538 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:31.974538 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:31.974545 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:31.976282 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.976620 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.976623 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.976623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.976686 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.976915 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.976916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.976916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.977045 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:31.977507 (+ 462us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:31.977546 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 00:09:31.977634 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":91,"threads_started":1}
Aug 12 00:09:31 dist-test-slave-6nmv krb5kdc[12942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.124@KRBTEST.COM for kudu/127.19.59.125@KRBTEST.COM
Aug 12 00:09:31 dist-test-slave-6nmv krb5kdc[12942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:31.983982 13210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.977734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:33511 (local address 127.0.0.1:35888)
0812 00:09:31.977793 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.977804 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:31.977887 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:31.978035 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:31.978036 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:31.978182 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:31.978215 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:31.978216 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.978944 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.978945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:31.979512 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:31.979514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.979932 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.979933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:31.979993 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.980311 (+ 318us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:31.980316 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:31.981588 (+ 1272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:31.983048 (+ 1460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:31.983048 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:31.983049 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:31.983210 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:31.983408 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:31.983408 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:31.983409 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:31.983461 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:31.983705 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:31.983706 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:31.983742 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:09:31.983818 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 00:09:31.983901 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 00:09:31.983986 13123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.977856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35888 (local address 127.19.59.125:33511)
0812 00:09:31.977906 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:31.977909 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:31.977918 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:09:31.977942 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:31.977943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:31.977952 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:31.978010 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:31.978305 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.978874 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.979581 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.979870 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.979916 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.981676 (+ 1760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:31.981678 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:31.981678 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:31.981685 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:31.982967 (+ 1282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.983286 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.983287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.983288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.983341 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.983526 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.983528 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.983528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.983638 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:31.983701 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:31.983843 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 00:09:31.983907 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:09:31.984278 13206 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:09:31.985424 13035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.978631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38180 (local address 127.19.59.126:43527)
0812 00:09:31.978666 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:31.978668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:31.978676 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:09:31.978696 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:31.978697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:31.978705 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:31.978754 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:31.979260 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.979711 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.980573 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.980728 (+ 155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.980804 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.982892 (+ 2088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:31.982893 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:31.982893 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:31.982900 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:31.984319 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.984700 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.984701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.984701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.984762 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.984952 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.984952 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.984953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.985082 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:31.985234 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:31.985268 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 00:09:31.985337 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Aug 12 00:09:31 dist-test-slave-6nmv krb5kdc[12942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.124@KRBTEST.COM for kudu/127.19.59.124@KRBTEST.COM
Aug 12 00:09:31 dist-test-slave-6nmv krb5kdc[12942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.125@KRBTEST.COM
I20260812 00:09:31.991205 13210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.984513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:34843 (local address 127.0.0.1:59282)
0812 00:09:31.984568 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:31.984579 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:31.984627 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:31.984783 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:31.984783 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:31.984938 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:31.984971 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:31.984973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.985791 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.985793 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:31.986498 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:31.986501 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.986850 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.986851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:31.986912 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.987244 (+ 332us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:31.987248 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:31.988315 (+ 1067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:31.989973 (+ 1658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:31.989974 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:31.989974 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:31.990146 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:31.990580 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:31.990581 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:31.990582 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:31.990643 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:31.990872 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:31.990873 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:31.990920 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 00:09:31.990997 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:09:31.991096 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 00:09:31.991299 13209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.984546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59282 (local address 127.19.59.124:34843)
0812 00:09:31.984575 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:31.984577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:31.984614 (+ 37us) server_negotiation.cc:407] Connection header received
0812 00:09:31.984709 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:31.984710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:31.984718 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:31.984779 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:31.985050 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.985692 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.986585 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.986765 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.986849 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.988405 (+ 1556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:31.988406 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:31.988406 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:31.988412 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:31.989889 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.990222 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.990222 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.990223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.990269 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.990716 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.990717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.990717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.990817 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:31.990871 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:31.991030 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 00:09:31.991169 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":13}
I20260812 00:09:31.993052 13123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:31.986107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35894 (local address 127.19.59.125:33511)
0812 00:09:31.986145 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:31.986151 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:31.986198 (+ 47us) server_negotiation.cc:407] Connection header received
0812 00:09:31.986263 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:31.986264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:31.986270 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:31.986310 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:31.986846 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.987403 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.988096 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:31.988319 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:31.988395 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:31.990359 (+ 1964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:31.990360 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:31.990360 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:31.990367 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:31.992081 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.992424 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.992424 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.992425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.992469 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:31.992637 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:31.992638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:31.992638 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:31.992725 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:31.992857 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:31.992952 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 00:09:31.992999 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:09:31.993124 13206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc: Bootstrap starting.
I20260812 00:09:31.994210 13206 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:31.994445 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:31.994566 13206 log.cc:824] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:31.995368 13206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc: No bootstrap required, opened a new log
I20260812 00:09:31.995680 13005 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "fd0fe782ee734dc49c87270566a1a7cc"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38180
I20260812 00:09:31.996991 13206 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } }
I20260812 00:09:31.997102 13206 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a12342f891d4cfdb381bb726021b6bc, State: Initialized, Role: FOLLOWER
I20260812 00:09:31.997180 13206 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } }
I20260812 00:09:31.997506 13206 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:31.997474 13213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } } }
I20260812 00:09:31.997602 13213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:09:31.999279 13225 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:09:31.999329 13225 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:09:31.999548 13126 master_runner.cc:186] Error getting master registration for 127.19.59.126:43527: OK, instance_id { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" instance_seqno: 1786493371671363 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:09:32.002287 13126 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:09:32.014053 13032 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } attempt: 2
Aug 12 00:09:32 dist-test-slave-6nmv krb5kdc[12942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for kudu/127.19.59.124@KRBTEST.COM
I20260812 00:09:32.021881 13209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:32.014405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59296 (local address 127.19.59.124:34843)
0812 00:09:32.014443 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.014445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.014492 (+ 47us) server_negotiation.cc:407] Connection header received
0812 00:09:32.014557 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.014558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.014568 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.014614 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.014954 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:32.015614 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:32.016643 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:32.016946 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:32.017008 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:32.019060 (+ 2052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:32.019062 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:32.019062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:32.019070 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:32.020752 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:32.021067 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:32.021068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:32.021069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:32.021120 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:32.021323 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:32.021325 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:32.021325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:32.021465 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:32.021547 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:32.021691 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 00:09:32.021767 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:09:32.021878 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:32.014325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:34843 (local address 127.0.0.1:59296)
0812 00:09:32.014423 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:32.014446 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:32.014503 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:32.014639 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:32.014640 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:32.014815 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:32.014883 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:32.014884 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:32.015723 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:32.015724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:32.016562 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:32.016564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:32.017018 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:32.017020 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:32.017082 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:32.017529 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:32.017534 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:32.018970 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:32.020823 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:32.020824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:32.020825 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:32.020994 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:32.021201 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:32.021201 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:32.021202 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:32.021264 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:32.021539 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:32.021540 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:32.021584 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 00:09:32.021668 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 00:09:32.021764 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260812 00:09:32.023239 13032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc: Bootstrap starting.
I20260812 00:09:32.024009 13032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:32.024314 13032 log.cc:824] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:32.025035 13032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc: No bootstrap required, opened a new log
I20260812 00:09:32.026453 13032 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } }
I20260812 00:09:32.026605 13032 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd0fe782ee734dc49c87270566a1a7cc, State: Initialized, Role: FOLLOWER
I20260812 00:09:32.026682 13032 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } }
I20260812 00:09:32.026957 13228 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } } }
I20260812 00:09:32.027014 13032 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:32.027056 13228 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:09:32.027185 13005 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 00:09:32.027297 13005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:32.028043 13005 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } }
W20260812 00:09:32.028771 13241 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:09:32.028864 13241 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:09:32.028855 13175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd0fe782ee734dc49c87270566a1a7cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3a12342f891d4cfdb381bb726021b6bc"
I20260812 00:09:32.028986 13175 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:32.029860 13175 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd0fe782ee734dc49c87270566a1a7cc in term 1.
I20260812 00:09:32.030133 12978 leader_election.cc:302] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a12342f891d4cfdb381bb726021b6bc, fd0fe782ee734dc49c87270566a1a7cc; no voters:
I20260812 00:09:32.030279 13228 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:32.030417 13228 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [term 1 LEADER]: Becoming Leader. State: Replica: fd0fe782ee734dc49c87270566a1a7cc, State: Running, Role: LEADER
I20260812 00:09:32.030506 13228 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } }
I20260812 00:09:32.030879 13228 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd0fe782ee734dc49c87270566a1a7cc. Latest consensus state: current_term: 1 leader_uuid: "fd0fe782ee734dc49c87270566a1a7cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } } }
I20260812 00:09:32.030983 13228 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:32.031129 13005 leader_election.cc:288] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [CANDIDATE]: Term 1 election: Requested vote from peers 1d8f88d3fa594e5db9acc58ed3643164 (127.19.59.125:33511), 3a12342f891d4cfdb381bb726021b6bc (127.19.59.124:34843)
I20260812 00:09:32.029927 12957 master_runner.cc:186] Error getting master registration for 127.19.59.125:33511: OK, instance_id { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" instance_seqno: 1786493371805989 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:09:32.032280 12957 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:09:32.033658 13245 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:32.034049 13245 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:32.038695 13119 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } attempt: 3
I20260812 00:09:32.041306 13035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:32.032423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38186 (local address 127.19.59.126:43527)
0812 00:09:32.032463 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.032465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.032746 (+ 281us) server_negotiation.cc:407] Connection header received
0812 00:09:32.032862 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.032863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.032872 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.032900 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.033734 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:32.034504 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:32.035623 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:32.035930 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:32.035972 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:32.037679 (+ 1707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:32.037681 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:32.037681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:32.037688 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:32.040062 (+ 2374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:32.040460 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:32.040461 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:32.040461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:32.040531 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:32.040740 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:32.040741 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:32.040741 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:32.040864 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:32.040956 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:32.041149 (+ 193us) server_negotiation.cc:299] Negotiation successful
0812 00:09:32.041224 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:09:32.045521 13123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:32.032881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35900 (local address 127.19.59.125:33511)
0812 00:09:32.032920 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.032922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.036054 (+ 3132us) server_negotiation.cc:407] Connection header received
0812 00:09:32.036195 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.036196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.036217 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.036248 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.037389 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:32.038110 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:32.039556 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:32.039870 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:32.039910 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:32.041833 (+ 1923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:32.041835 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:32.041835 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:32.041842 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:32.043957 (+ 2115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:32.044514 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:32.044515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:32.044515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:32.044578 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:32.044846 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:32.044847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:32.044847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:32.044978 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:32.045052 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:32.045320 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 00:09:32.045426 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:09:32.050969 13175 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc [term 1 FOLLOWER]: Refusing update from remote peer fd0fe782ee734dc49c87270566a1a7cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:09:32.051551 13243 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Aug 12 00:09:32 dist-test-slave-6nmv krb5kdc[12942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493371, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.125@KRBTEST.COM for kudu/127.19.59.124@KRBTEST.COM
I20260812 00:09:32.053314 13213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd0fe782ee734dc49c87270566a1a7cc. Latest consensus state: current_term: 1 leader_uuid: "fd0fe782ee734dc49c87270566a1a7cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } } }
I20260812 00:09:32.053412 13213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:09:32.055294 13243 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fd0fe782ee734dc49c87270566a1a7cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } } }
I20260812 00:09:32.055402 13243 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:32.055481 13255 mvcc.cc:205] Tried to move back new op lower bound from 7317476851917602816 to 7317476851837612032. Current Snapshot: MvccSnapshot[applied={T|T < 7317476851917602816}]
I20260812 00:09:32.056001 13258 mvcc.cc:205] Tried to move back new op lower bound from 7317476851917602816 to 7317476851837612032. Current Snapshot: MvccSnapshot[applied={T|T < 7317476851917602816}]
I20260812 00:09:32.056092 13213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fd0fe782ee734dc49c87270566a1a7cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } } }
I20260812 00:09:32.056180 13213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:09:32.057310 13245 catalog_manager.cc:1347] Generated new cluster ID: 063feb5deef24c3880c5cb41c5faae85
I20260812 00:09:32.057374 13245 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:32.057448 13209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:32.033258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59298 (local address 127.19.59.124:34843)
0812 00:09:32.033291 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.033292 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.037936 (+ 4644us) server_negotiation.cc:407] Connection header received
0812 00:09:32.038023 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.038023 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.038033 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.038058 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.038711 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:32.039383 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:32.049900 (+ 10517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:32.050184 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:32.050226 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:32.052141 (+ 1915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:32.052143 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:32.052143 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:32.052150 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:32.055764 (+ 3614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:32.056190 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:32.056192 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:32.056193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:32.056269 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:32.056543 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:32.056544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:32.056544 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:32.056696 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:32.056791 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:32.057265 (+ 474us) server_negotiation.cc:299] Negotiation successful
0812 00:09:32.057365 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:09:32.058907 13121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:32.038930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:34843 (local address 127.0.0.1:59308)
0812 00:09:32.039019 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:32.039028 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:32.039065 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:32.048655 (+ 9590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:32.048656 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:32.048811 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:32.048854 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:32.048855 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:32.049787 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:32.049788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:32.050536 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:32.050540 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:32.051442 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:32.051443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:32.051525 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:32.051942 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:32.051948 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:32.053507 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:32.057781 (+ 4274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:32.057782 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:32.057782 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:32.058039 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:32.058291 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:32.058292 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:32.058292 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:32.058360 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:32.058628 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:32.058628 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:32.058679 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 00:09:32.058729 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:09:32.058815 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260812 00:09:32.059254 13257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:32.039132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59308 (local address 127.19.59.124:34843)
0812 00:09:32.048462 (+ 9330us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.048464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.048474 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:09:32.048508 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.048509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.048520 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.048635 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.048939 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:32.049714 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:32.050671 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:32.050985 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:32.051144 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:32.053611 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:32.053612 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:32.053613 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:32.053620 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:32.055550 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:32.058136 (+ 2586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:32.058137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:32.058138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:32.058221 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:32.058430 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:32.058430 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:32.058431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:32.058547 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:32.058593 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:32.059089 (+ 496us) server_negotiation.cc:299] Negotiation successful
0812 00:09:32.059162 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9303,"thread_start_us":85,"threads_started":1}
I20260812 00:09:32.060473 13119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164: Bootstrap starting.
I20260812 00:09:32.061115 13119 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:32.061365 13119 log.cc:824] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:32.069435 13119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164: No bootstrap required, opened a new log
I20260812 00:09:32.071202 13119 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } }
I20260812 00:09:32.071322 13119 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d8f88d3fa594e5db9acc58ed3643164, State: Initialized, Role: FOLLOWER
I20260812 00:09:32.071388 13119 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } }
I20260812 00:09:32.071689 13119 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:32.072814 13090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd0fe782ee734dc49c87270566a1a7cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1d8f88d3fa594e5db9acc58ed3643164"
I20260812 00:09:32.072904 13090 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:32.073588 13090 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd0fe782ee734dc49c87270566a1a7cc in term 1.
I20260812 00:09:32.073913 13089 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164 [term 1 FOLLOWER]: Refusing update from remote peer fd0fe782ee734dc49c87270566a1a7cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:09:32.074131 13228 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:09:32.075840 13275 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:09:32.075894 13275 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:09:32.077888 13264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd0fe782ee734dc49c87270566a1a7cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } } }
I20260812 00:09:32.077939 13277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd0fe782ee734dc49c87270566a1a7cc. Latest consensus state: current_term: 1 leader_uuid: "fd0fe782ee734dc49c87270566a1a7cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } } }
I20260812 00:09:32.077986 13264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:09:32.078048 13264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fd0fe782ee734dc49c87270566a1a7cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } } }
I20260812 00:09:32.078099 13264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:09:32.077993 13277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:09:32.078352 13278 mvcc.cc:205] Tried to move back new op lower bound from 7317476851917602816 to 7317476851837612032. Current Snapshot: MvccSnapshot[applied={T|T < 7317476851917602816}]
I20260812 00:09:32.087658 13228 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fd0fe782ee734dc49c87270566a1a7cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd0fe782ee734dc49c87270566a1a7cc" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 43527 } } peers { permanent_uuid: "1d8f88d3fa594e5db9acc58ed3643164" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 33511 } } peers { permanent_uuid: "3a12342f891d4cfdb381bb726021b6bc" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 34843 } } }
I20260812 00:09:32.087754 13228 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:32.089931 13245 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:32.090579 13245 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:32.095721 13245 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd0fe782ee734dc49c87270566a1a7cc: Generated new TSK 0
I20260812 00:09:32.095888 13245 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:09:32.121134 13123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:32.119629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35914 (local address 127.19.59.125:33511)
0812 00:09:32.119671 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.119673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.120498 (+ 825us) server_negotiation.cc:407] Connection header received
0812 00:09:32.120623 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.120624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.120635 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.120662 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.121066 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35914: BlockingRecv error: recv got EOF from 127.0.0.1:35914 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 00:09:32.121953 13035 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:32.120243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38198 (local address 127.19.59.126:43527)
0812 00:09:32.120279 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.120281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.121428 (+ 1147us) server_negotiation.cc:407] Connection header received
0812 00:09:32.121551 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.121552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.121561 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.121604 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.121894 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38198: BlockingRecv error: recv got EOF from 127.0.0.1:38198 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 00:09:32.122511 13257 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:32.119944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59316 (local address 127.19.59.124:34843)
0812 00:09:32.119979 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.119981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.121369 (+ 1388us) server_negotiation.cc:407] Connection header received
0812 00:09:32.122088 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.122089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.122103 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.122131 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.122445 (+ 314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59316: BlockingRecv error: recv got EOF from 127.0.0.1:59316 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 00:09:32.124764 13123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:32.124112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35918 (local address 127.19.59.125:33511)
0812 00:09:32.124142 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.124143 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.124306 (+ 163us) server_negotiation.cc:407] Connection header received
0812 00:09:32.124397 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.124398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.124413 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.124439 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.124722 (+ 283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35918: BlockingRecv error: recv got EOF from 127.0.0.1:35918 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260812 00:09:32.127560 13123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:32.126905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35932 (local address 127.19.59.125:33511)
0812 00:09:32.126943 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.126944 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.127149 (+ 205us) server_negotiation.cc:407] Connection header received
0812 00:09:32.127231 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.127232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.127240 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.127265 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.127522 (+ 257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35932: BlockingRecv error: recv got EOF from 127.0.0.1:35932 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 00:09:32.131083 13123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:32.130470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35936 (local address 127.19.59.125:33511)
0812 00:09:32.130498 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.130499 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.130702 (+ 203us) server_negotiation.cc:407] Connection header received
0812 00:09:32.130779 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.130780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.130787 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.130810 (+ 23us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.131049 (+ 239us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35936: BlockingRecv error: recv got EOF from 127.0.0.1:35936 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260812 00:09:32.136749 13123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:32.136031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35942 (local address 127.19.59.125:33511)
0812 00:09:32.136064 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.136065 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.136284 (+ 219us) server_negotiation.cc:407] Connection header received
0812 00:09:32.136373 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.136373 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.136382 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.136409 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.136709 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35942: BlockingRecv error: recv got EOF from 127.0.0.1:35942 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 00:09:32.146704 13123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:32.145898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35950 (local address 127.19.59.125:33511)
0812 00:09:32.145935 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.145937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.146183 (+ 246us) server_negotiation.cc:407] Connection header received
0812 00:09:32.146279 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.146280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.146290 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.146319 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.146655 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35950: BlockingRecv error: recv got EOF from 127.0.0.1:35950 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 00:09:32.164896 13123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:32.163888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35966 (local address 127.19.59.125:33511)
0812 00:09:32.163944 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.163946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.164259 (+ 313us) server_negotiation.cc:407] Connection header received
0812 00:09:32.164369 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.164371 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.164383 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.164416 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.164825 (+ 409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35966: BlockingRecv error: recv got EOF from 127.0.0.1:35966 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 00:09:32.199241 13123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:32.198414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35972 (local address 127.19.59.125:33511)
0812 00:09:32.198461 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.198463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.198674 (+ 211us) server_negotiation.cc:407] Connection header received
0812 00:09:32.198733 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.198735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.198748 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.198817 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.199185 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35972: BlockingRecv error: recv got EOF from 127.0.0.1:35972 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 00:09:32.265130 13123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:32.264447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35978 (local address 127.19.59.125:33511)
0812 00:09:32.264537 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.264539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.264639 (+ 100us) server_negotiation.cc:407] Connection header received
0812 00:09:32.264673 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.264674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.264684 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.264748 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.265060 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35978: BlockingRecv error: recv got EOF from 127.0.0.1:35978 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260812 00:09:32.395009 13123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:32.394316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35986 (local address 127.19.59.125:33511)
0812 00:09:32.394416 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.394418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.394448 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:09:32.394533 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.394534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.394555 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.394592 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.394954 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35986: BlockingRecv error: recv got EOF from 127.0.0.1:35986 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260812 00:09:32.652681 13123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:32.652108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35998 (local address 127.19.59.125:33511)
0812 00:09:32.652173 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:32.652175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:32.652225 (+ 50us) server_negotiation.cc:407] Connection header received
0812 00:09:32.652272 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:32.652272 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:32.652281 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:32.652340 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:32.652634 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35998: BlockingRecv error: recv got EOF from 127.0.0.1:35998 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:09:32.999755 13225 catalog_manager.cc:1259] Loaded cluster ID: 063feb5deef24c3880c5cb41c5faae85
I20260812 00:09:32.999838 13225 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc: loading cluster ID for follower catalog manager: success
I20260812 00:09:33.000605 13225 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc: acquiring CA information for follower catalog manager: success
I20260812 00:09:33.000890 13225 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3a12342f891d4cfdb381bb726021b6bc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:09:33.076414 13275 catalog_manager.cc:1259] Loaded cluster ID: 063feb5deef24c3880c5cb41c5faae85
I20260812 00:09:33.076537 13275 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164: loading cluster ID for follower catalog manager: success
I20260812 00:09:33.077360 13275 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164: acquiring CA information for follower catalog manager: success
I20260812 00:09:33.077689 13275 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1d8f88d3fa594e5db9acc58ed3643164: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:09:33.168648 13359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:33.165889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36008 (local address 127.19.59.125:33511)
0812 00:09:33.166027 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:33.166029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:33.166119 (+ 90us) server_negotiation.cc:407] Connection header received
0812 00:09:33.166218 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:33.166219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:33.166286 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:33.166377 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:09:33.166536 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:33.167050 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:33.167825 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:33.168014 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:33.168095 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:33.168262 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:09:33.168374 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:09:33.168492 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:33.168512 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 00:09:33.168535 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
I20260812 00:09:33.172777 13366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:33.170495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59318 (local address 127.19.59.124:34843)
0812 00:09:33.170619 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:33.170621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:33.170629 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:09:33.170664 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:33.170664 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:33.170697 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:33.170769 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:09:33.170858 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:33.171326 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:33.172099 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:33.172288 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:33.172334 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:33.172448 (+ 114us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:09:33.172535 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:09:33.172587 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:33.172664 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 00:09:33.172685 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":68,"threads_started":1}
I20260812 00:09:33.177102 13359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:33.174363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36020 (local address 127.19.59.125:33511)
0812 00:09:33.174401 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:33.174403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:33.174552 (+ 149us) server_negotiation.cc:407] Connection header received
0812 00:09:33.174608 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:33.174609 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:33.174619 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:33.174658 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:09:33.174744 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:33.175362 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:33.176157 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:33.176352 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:33.176420 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:33.176567 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:09:33.176599 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:09:33.176650 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:33.177032 (+ 382us) server_negotiation.cc:299] Negotiation successful
0812 00:09:33.177049 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:09:33.177397 13366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:33.174552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59332 (local address 127.19.59.124:34843)
0812 00:09:33.174587 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:33.174589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:33.174881 (+ 292us) server_negotiation.cc:407] Connection header received
0812 00:09:33.174954 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:33.174954 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:33.174963 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:33.175001 (+ 38us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:09:33.175091 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:33.175557 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:33.176737 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:33.176954 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:33.177011 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:33.177165 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:09:33.177194 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:09:33.177242 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:33.177324 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 00:09:33.177342 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:09:33.177667 13375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:33.174388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38202 (local address 127.19.59.126:43527)
0812 00:09:33.174596 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:33.174598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:33.174605 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:09:33.174648 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:33.174648 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:33.174691 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:33.174770 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:09:33.174919 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:33.175573 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:33.176773 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:33.177089 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:33.177147 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:33.177345 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:09:33.177442 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:09:33.177496 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:33.177551 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 00:09:33.177573 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":66,"threads_started":1}
I20260812 00:09:33.179268 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 12957
I20260812 00:09:33.187747 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 13040
I20260812 00:09:33.194213 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 13126
2026-08-12T00:09:33Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2808 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:09:33 dist-test-slave-6nmv krb5kdc[13380](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:09:33 dist-test-slave-6nmv krb5kdc[13380](info): set up 2 sockets
Aug 12 00:09:33 dist-test-slave-6nmv krb5kdc[13380](info): commencing operation
krb5kdc: starting...
W20260812 00:09:34.242755 19693 mini_kdc.cc:121] Time spent starting KDC: real 1.026s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/test-user.keytab.
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:09:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:09:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.59.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
Entry for principal kudu/127.19.59.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab.
I20260812 00:09:34.351949 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:40577
--webserver_interface=127.19.59.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:40577,127.19.59.125:44117,127.19.59.124:45269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:09:34.429138 13394 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:09:34.429338 13394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:34.429364 13394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:34.429401 13394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:34.430366 13394 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:34.430436 13394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:34.430457 13394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:34.430476 13394 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:34.430512 13394 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:34.431910 13394 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:40577,127.19.59.125:44117,127.19.59.124:45269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.126.keytab
--principal=kudu/127.19.59.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.126:40577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.59.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:34.432169 13394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:34.432400 13394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:34.437155 13401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:34.437144 13400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:34.437144 13403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:34.437203 13394 server_base.cc:1034] running on GCE node
I20260812 00:09:34.437556 13394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:34.437851 13394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:34.438992 13394 hybrid_clock.cc:648] HybridClock initialized: now 1786493374438968 us; error 38 us; skew 500 ppm
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:34.441161 13394 init.cc:377] Logged in from keytab as kudu/127.19.59.126@KRBTEST.COM (short username kudu)
I20260812 00:09:34.441526 13394 webserver.cc:460] Webserver started at http://127.19.59.126:36581/ using document root <none> and password file <none>
I20260812 00:09:34.441730 13394 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:34.441792 13394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:34.441973 13394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:34.443056 13394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/data/instance:
uuid: "08f422e8e74944628391a3392c475c69"
format_stamp: "Formatted at 2026-08-12 00:09:34 on dist-test-slave-6nmv"
server_key: "4f2ce75c482fbd6c9e0230ac7faffa46"
server_key_iv: "64ac4e1237f7ed4e89633b5e23cd0aef"
server_key_version: "encryptionkey@0"
I20260812 00:09:34.443424 13394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/wal/instance:
uuid: "08f422e8e74944628391a3392c475c69"
format_stamp: "Formatted at 2026-08-12 00:09:34 on dist-test-slave-6nmv"
server_key: "4f2ce75c482fbd6c9e0230ac7faffa46"
server_key_iv: "64ac4e1237f7ed4e89633b5e23cd0aef"
server_key_version: "encryptionkey@0"
I20260812 00:09:34.445122 13394 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 00:09:34.446039 13411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:34.446210 13394 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:09:34.446293 13394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/wal
uuid: "08f422e8e74944628391a3392c475c69"
format_stamp: "Formatted at 2026-08-12 00:09:34 on dist-test-slave-6nmv"
server_key: "4f2ce75c482fbd6c9e0230ac7faffa46"
server_key_iv: "64ac4e1237f7ed4e89633b5e23cd0aef"
server_key_version: "encryptionkey@0"
I20260812 00:09:34.446364 13394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:34.458494 13394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:34.460791 13394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:34.460909 13394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:34.465799 13394 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.126:40577
I20260812 00:09:34.465873 13470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.126:40577 every 8 connection(s)
I20260812 00:09:34.466275 13394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/data/info.pb
I20260812 00:09:34.467366 13471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:34.468806 13471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:34.476171 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 13394
I20260812 00:09:34.476291 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-0/wal/instance
I20260812 00:09:34.476505 19693 external_mini_cluster.cc:1428] Setting key 6506cd7662059746b4281a865585d06c
I20260812 00:09:34.480748 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.469458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:40577 (local address 127.0.0.1:53098)
0812 00:09:34.469698 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.469720 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:34.470199 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:34.470504 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:34.470507 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:34.470793 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:34.471000 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.471006 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.471920 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.471921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.472958 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.472961 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.473616 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.473617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.473668 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.474121 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:34.474128 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:34.475370 (+ 1242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:34.479059 (+ 3689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.479065 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.479067 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.479344 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.479627 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.479628 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.479629 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.479731 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.480162 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:34.480169 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:34.480238 (+ 69us) client_negotiation.cc:769] Sending connection context
0812 00:09:34.480325 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 00:09:34.480484 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":98,"threads_started":1}
I20260812 00:09:34.482252 13473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.469486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53098 (local address 127.19.59.126:40577)
0812 00:09:34.469644 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.469657 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.469799 (+ 142us) server_negotiation.cc:407] Connection header received
0812 00:09:34.470332 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.470334 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.470352 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.470430 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.471087 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.471831 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.473039 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.473524 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.473626 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.475451 (+ 1825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:34.475460 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:34.475460 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:34.475468 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:34.478953 (+ 3485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.479429 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.479433 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.479433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.479541 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.479799 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.479800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.479800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.480086 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:34.480172 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:34.482091 (+ 1919us) server_negotiation.cc:299] Negotiation successful
0812 00:09:34.482164 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":78,"threads_started":1}
I20260812 00:09:34.482941 13471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:09:34.483258 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.483145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:44117 (local address 127.0.0.1:33268)
0812 00:09:34.483173 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.483209 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260812 00:09:34.483356 13413 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.59.125:44117: connect: Connection refused (error 111)
I20260812 00:09:34.483757 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.483630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:44117 (local address 127.0.0.1:33280)
0812 00:09:34.483702 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.483724 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 00:09:34.483913 13471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.125:44117: Network error: Client connection negotiation failed: client connection to 127.19.59.125:44117: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.19.59.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.125.keytab.
Entry for principal kudu/127.19.59.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.125.keytab.
I20260812 00:09:34.502493 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.125:44117
--webserver_interface=127.19.59.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.125.keytab
--principal=kudu/127.19.59.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:40577,127.19.59.125:44117,127.19.59.124:45269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:09:34.533154 13471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } attempt: 1
I20260812 00:09:34.533773 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.533614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:44117 (local address 127.0.0.1:60536)
0812 00:09:34.533684 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.533734 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 00:09:34.534228 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.534117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:44117 (local address 127.0.0.1:60548)
0812 00:09:34.534168 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.534202 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 00:09:34.534336 13471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.125:44117: Network error: Client connection negotiation failed: client connection to 127.19.59.125:44117: connect: Connection refused (error 111)
W20260812 00:09:34.580663 13478 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:09:34.580847 13478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:34.580873 13478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:34.580911 13478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:09:34.581888 13478 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:34.581926 13478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:34.581941 13478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:34.581954 13478 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:34.581967 13478 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:34.583228 13478 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:40577,127.19.59.125:44117,127.19.59.124:45269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.125.keytab
--principal=kudu/127.19.59.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.125:44117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.59.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:34.583391 13478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:34.583557 13478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:34.587996 13486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:34.588059 13484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:34.588176 13478 server_base.cc:1034] running on GCE node
W20260812 00:09:34.588056 13483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:34.588574 13478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:34.588830 13478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:34.589979 13478 hybrid_clock.cc:648] HybridClock initialized: now 1786493374589971 us; error 31 us; skew 500 ppm
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:34.592330 13478 init.cc:377] Logged in from keytab as kudu/127.19.59.125@KRBTEST.COM (short username kudu)
I20260812 00:09:34.592748 13478 webserver.cc:460] Webserver started at http://127.19.59.125:41629/ using document root <none> and password file <none>
I20260812 00:09:34.592994 13478 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:34.593060 13478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:34.593194 13478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:34.594206 13478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/data/instance:
uuid: "7bcb14322d254b8383ed227970c8db27"
format_stamp: "Formatted at 2026-08-12 00:09:34 on dist-test-slave-6nmv"
server_key: "2a20b74decbe58a6dabb3f8fafc0f085"
server_key_iv: "379f8f57748d9b52f0ad67730f2abfde"
server_key_version: "encryptionkey@0"
I20260812 00:09:34.594529 13478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/wal/instance:
uuid: "7bcb14322d254b8383ed227970c8db27"
format_stamp: "Formatted at 2026-08-12 00:09:34 on dist-test-slave-6nmv"
server_key: "2a20b74decbe58a6dabb3f8fafc0f085"
server_key_iv: "379f8f57748d9b52f0ad67730f2abfde"
server_key_version: "encryptionkey@0"
I20260812 00:09:34.595733 13478 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:09:34.596437 13494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:34.596612 13478 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:09:34.596709 13478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/wal
uuid: "7bcb14322d254b8383ed227970c8db27"
format_stamp: "Formatted at 2026-08-12 00:09:34 on dist-test-slave-6nmv"
server_key: "2a20b74decbe58a6dabb3f8fafc0f085"
server_key_iv: "379f8f57748d9b52f0ad67730f2abfde"
server_key_version: "encryptionkey@0"
I20260812 00:09:34.596783 13478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:34.602496 13471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } attempt: 2
I20260812 00:09:34.602988 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.602847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:44117 (local address 127.0.0.1:60554)
0812 00:09:34.602913 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.602953 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 00:09:34.603400 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.603300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:44117 (local address 127.0.0.1:60564)
0812 00:09:34.603350 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.603378 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.125:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 00:09:34.603513 13471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.125:44117: Network error: Client connection negotiation failed: client connection to 127.19.59.125:44117: connect: Connection refused (error 111)
I20260812 00:09:34.613122 13478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:34.615429 13478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:34.615582 13478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:34.619606 13478 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.125:44117
I20260812 00:09:34.619634 13550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.125:44117 every 8 connection(s)
I20260812 00:09:34.619935 13478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/data/info.pb
I20260812 00:09:34.620774 13551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:34.622219 13551 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:09:34.626573 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 13478
I20260812 00:09:34.626688 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-1/wal/instance
I20260812 00:09:34.626884 19693 external_mini_cluster.cc:1428] Setting key 000a9d67c694728cf09115a585eadaaf
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.125@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:34.630719 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.622842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:40577 (local address 127.0.0.1:48104)
0812 00:09:34.623009 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.623043 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:34.623431 (+ 388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:34.623636 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:34.623639 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:34.623851 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:34.624017 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.624021 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.624613 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.624614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.625335 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.625337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.625664 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.625665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.625762 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.626287 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:34.626295 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:34.627676 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:34.629320 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.629326 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.629328 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.629636 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.629901 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.629902 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.629902 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.629997 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.630284 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:34.630288 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:34.630400 (+ 112us) client_negotiation.cc:769] Sending connection context
0812 00:09:34.630477 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:09:34.630590 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":102,"threads_started":1}
I20260812 00:09:34.630743 13473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.622875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48104 (local address 127.19.59.126:40577)
0812 00:09:34.622927 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.622929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.623122 (+ 193us) server_negotiation.cc:407] Connection header received
0812 00:09:34.623503 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.623504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.623513 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.623563 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.624079 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.624533 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.625401 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.625583 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.625631 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.627760 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:34.627762 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:34.627762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:34.627770 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:34.629235 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.629734 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.629735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.629735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.629799 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.630065 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.630066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.630066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.630217 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:34.630288 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:34.630530 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 00:09:34.630617 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:09:34.631321 13551 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.125@KRBTEST.COM for kudu/127.19.59.125@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.59.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.59.124@KRBTEST.COM" created.
I20260812 00:09:34.638541 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.631557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:44117 (local address 127.0.0.1:60572)
0812 00:09:34.631619 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.631630 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:34.631674 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:34.631872 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:34.631873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:34.632031 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:34.632088 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.632090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.632888 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.632889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.633716 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.633719 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.634205 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.634206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.634292 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.634623 (+ 331us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:34.634627 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:34.635813 (+ 1186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:34.637547 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.637547 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.637548 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.637706 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.637958 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.637958 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.637959 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.638007 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.638271 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:34.638272 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:34.638304 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 00:09:34.638368 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 00:09:34.638458 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 00:09:34.638746 13555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.631591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60572 (local address 127.19.59.125:44117)
0812 00:09:34.631742 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.631746 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.631766 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:09:34.631783 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.631784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.631793 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.631850 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.632159 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.632800 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.633793 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.634124 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.634180 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.635946 (+ 1766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:34.635956 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:34.635956 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:34.635969 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:34.637447 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.637795 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.637798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.637798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.637889 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.638077 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.638078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.638078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.638205 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:34.638291 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:34.638395 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 00:09:34.638673 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":203,"server-negotiator.queue_time_us":126,"thread_start_us":102,"threads_started":1}
I20260812 00:09:34.639204 13551 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:09:34.639562 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.639413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:45269 (local address 127.0.0.1:40848)
0812 00:09:34.639464 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.639531 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 00:09:34.639695 13498 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
I20260812 00:09:34.640137 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.640034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:45269 (local address 127.0.0.1:40850)
0812 00:09:34.640092 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.640116 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 00:09:34.640585 13551 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.124:45269: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.59.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.124.keytab.
Entry for principal kudu/127.19.59.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.124.keytab.
I20260812 00:09:34.656245 19693 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBmexS9/build/release/bin/kudu
/tmp/dist-test-taskBmexS9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.124:45269
--webserver_interface=127.19.59.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.124.keytab
--principal=kudu/127.19.59.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.59.84:38469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.59.126:40577,127.19.59.125:44117,127.19.59.124:45269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:09:34.689868 13551 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } attempt: 1
I20260812 00:09:34.690372 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.690211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:45269 (local address 127.0.0.1:40860)
0812 00:09:34.690273 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.690336 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 00:09:34.690696 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.690595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:45269 (local address 127.0.0.1:40862)
0812 00:09:34.690640 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.690664 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 00:09:34.690785 13551 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.124:45269: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
I20260812 00:09:34.694676 13471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } attempt: 3
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for kudu/127.19.59.125@KRBTEST.COM
I20260812 00:09:34.701567 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.694959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:44117 (local address 127.0.0.1:60584)
0812 00:09:34.695013 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.695021 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:34.695055 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:34.695245 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:34.695246 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:34.695414 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:34.695480 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.695482 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.696164 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.696165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.696702 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.696704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.697108 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.697109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.697201 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.697680 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:34.697687 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:34.698936 (+ 1249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:34.700622 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.700622 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.700623 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.700788 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.700975 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.700975 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.700976 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.701028 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.701267 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:34.701269 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:34.701308 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 00:09:34.701381 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 00:09:34.701468 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 00:09:34.701570 13555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.695047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60584 (local address 127.19.59.125:44117)
0812 00:09:34.695108 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.695111 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.695119 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:09:34.695158 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.695158 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.695166 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.695224 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.695557 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.696064 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.696795 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.697019 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.697110 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.699024 (+ 1914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:34.699026 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:34.699026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:34.699033 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:34.700535 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.700852 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.700853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.700853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.700903 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.701101 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.701102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.701102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.701203 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:34.701266 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:34.701403 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 00:09:34.701468 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 00:09:34.701901 13471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:09:34.702203 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.702116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:45269 (local address 127.0.0.1:40866)
0812 00:09:34.702159 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.702182 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:09:34.702520 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.702471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:45269 (local address 127.0.0.1:40872)
0812 00:09:34.702492 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.702510 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260812 00:09:34.702629 13471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.124:45269: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
W20260812 00:09:34.733501 13558 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:09:34.733657 13558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:09:34.733672 13558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:09:34.733707 13558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 00:09:34.733786 13471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } attempt: 1
I20260812 00:09:34.734144 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.734041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:45269 (local address 127.0.0.1:40884)
0812 00:09:34.734094 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.734126 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 00:09:34.734509 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.734419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:45269 (local address 127.0.0.1:40890)
0812 00:09:34.734455 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.734495 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 00:09:34.734618 13471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.124:45269: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
W20260812 00:09:34.735008 13558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:09:34.735044 13558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:09:34.735056 13558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:09:34.735069 13558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:09:34.735080 13558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:09:34.736402 13558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.59.84:38469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.59.126:40577,127.19.59.125:44117,127.19.59.124:45269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/krb5kdc/kudu_127.19.59.124.keytab
--principal=kudu/127.19.59.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.59.124:45269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.59.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:57:27 UTC on ccycloud.quasar-xbduhr.root.comops.site
build id 4581601
I20260812 00:09:34.736584 13558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:09:34.736740 13558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:09:34.740866 13567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:34.740865 13565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:09:34.740876 13564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:09:34.741143 13558 server_base.cc:1034] running on GCE node
I20260812 00:09:34.741323 13558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:09:34.741555 13558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:09:34.742689 13558 hybrid_clock.cc:648] HybridClock initialized: now 1786493374742682 us; error 24 us; skew 500 ppm
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:09:34.744783 13558 init.cc:377] Logged in from keytab as kudu/127.19.59.124@KRBTEST.COM (short username kudu)
I20260812 00:09:34.745131 13558 webserver.cc:460] Webserver started at http://127.19.59.124:46615/ using document root <none> and password file <none>
I20260812 00:09:34.745334 13558 fs_manager.cc:359] Metadata directory not provided
I20260812 00:09:34.745391 13558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:09:34.745520 13558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:09:34.746505 13558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/data/instance:
uuid: "9cf8915cd55b4bba818cc5482bd799f0"
format_stamp: "Formatted at 2026-08-12 00:09:34 on dist-test-slave-6nmv"
server_key: "d1df149141bf23ff5b17936b25046fee"
server_key_iv: "36c605464ab7ee574b14b4674ce44e90"
server_key_version: "encryptionkey@0"
I20260812 00:09:34.746856 13558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/wal/instance:
uuid: "9cf8915cd55b4bba818cc5482bd799f0"
format_stamp: "Formatted at 2026-08-12 00:09:34 on dist-test-slave-6nmv"
server_key: "d1df149141bf23ff5b17936b25046fee"
server_key_iv: "36c605464ab7ee574b14b4674ce44e90"
server_key_version: "encryptionkey@0"
I20260812 00:09:34.748023 13558 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:09:34.748697 13576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:09:34.748848 13558 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:09:34.748939 13558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/data,/tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/wal
uuid: "9cf8915cd55b4bba818cc5482bd799f0"
format_stamp: "Formatted at 2026-08-12 00:09:34 on dist-test-slave-6nmv"
server_key: "d1df149141bf23ff5b17936b25046fee"
server_key_iv: "36c605464ab7ee574b14b4674ce44e90"
server_key_version: "encryptionkey@0"
I20260812 00:09:34.749009 13558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:09:34.758913 13551 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } attempt: 2
I20260812 00:09:34.759269 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.759147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:45269 (local address 127.0.0.1:40896)
0812 00:09:34.759198 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.759246 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 00:09:34.759593 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.759490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:45269 (local address 127.0.0.1:40902)
0812 00:09:34.759546 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.759570 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 00:09:34.759686 13551 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.59.124:45269: Network error: Client connection negotiation failed: client connection to 127.19.59.124:45269: connect: Connection refused (error 111)
I20260812 00:09:34.767450 13558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:09:34.768909 13558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:09:34.769047 13558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:09:34.773008 13558 rpc_server.cc:307] RPC server started. Bound to: 127.19.59.124:45269
I20260812 00:09:34.773037 13634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.59.124:45269 every 8 connection(s)
I20260812 00:09:34.773326 13558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/data/info.pb
I20260812 00:09:34.774237 13635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:09:34.775609 13635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.124@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
I20260812 00:09:34.780797 19693 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBmexS9/build/release/bin/kudu as pid 13558
I20260812 00:09:34.780921 19693 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBmexS9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786493109864389-19693-0/minicluster-data/master-2/wal/instance
I20260812 00:09:34.781180 19693 external_mini_cluster.cc:1428] Setting key fbf53ebb6b9509d5713db9410f2e45c4
I20260812 00:09:34.783960 13473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.776240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48114 (local address 127.19.59.126:40577)
0812 00:09:34.776312 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.776315 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.776519 (+ 204us) server_negotiation.cc:407] Connection header received
0812 00:09:34.776925 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.776926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.776935 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.776986 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.777507 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.777971 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.778794 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.778945 (+ 151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.778988 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.780891 (+ 1903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:34.780893 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:34.780893 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:34.780901 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:34.782593 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.783009 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.783010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.783010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.783069 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.783305 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.783306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.783306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.783415 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:34.783499 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:34.783781 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 00:09:34.783868 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 00:09:34.784149 13637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.776229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.126:40577 (local address 127.0.0.1:48114)
0812 00:09:34.776412 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.776444 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:34.776850 (+ 406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:34.777044 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:34.777046 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:34.777282 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:34.777441 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.777444 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.778038 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.778039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.778720 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.778722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.779014 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.779015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.779126 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.779465 (+ 339us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:34.779472 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:34.780784 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:34.782670 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.782675 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.782677 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.782932 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.783132 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.783133 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.783133 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.783248 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.783505 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:34.783514 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:34.783646 (+ 132us) client_negotiation.cc:769] Sending connection context
0812 00:09:34.783756 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 00:09:34.783930 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":106,"threads_started":1}
I20260812 00:09:34.784696 13635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.124@KRBTEST.COM
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.124@KRBTEST.COM for kudu/127.19.59.125@KRBTEST.COM
I20260812 00:09:34.790081 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.781580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40918 (local address 127.19.59.124:45269)
0812 00:09:34.781723 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.781727 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.781750 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:09:34.781834 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.781837 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.781849 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.781906 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.782458 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.783389 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.784108 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.784567 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.784626 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.787141 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:34.787149 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:34.787149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:34.787155 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:34.788917 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.789306 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.789309 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.789309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.789367 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.789554 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.789555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.789555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.789685 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:34.789849 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:34.789911 (+ 62us) server_negotiation.cc:299] Negotiation successful
0812 00:09:34.789982 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
I20260812 00:09:34.791515 13637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.784958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.125:44117 (local address 127.0.0.1:60590)
0812 00:09:34.785011 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.785022 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:34.785058 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:34.785214 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:34.785216 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:34.785357 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:34.785410 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.785412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.786077 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.786078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.786593 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.786595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.787047 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.787048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.787153 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.787534 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:34.787538 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:34.788788 (+ 1250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:34.790531 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.790532 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.790532 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.790766 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.790956 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.790956 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.790957 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.791017 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.791251 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:34.791252 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:34.791290 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:09:34.791352 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 00:09:34.791434 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 00:09:34.791525 13555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.785033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60590 (local address 127.19.59.125:44117)
0812 00:09:34.785085 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.785087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.785096 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:09:34.785128 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.785129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.785140 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.785202 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.785488 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.785995 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.786728 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.786957 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.787020 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.788868 (+ 1848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:34.788869 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:34.788869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:34.788876 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:34.790374 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.790835 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.790836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.790836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.790887 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.791091 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.791092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.791092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.791192 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:34.791258 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:34.791379 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 00:09:34.791440 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:09:34.792287 13635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.126@KRBTEST.COM
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.124@KRBTEST.COM for kudu/127.19.59.124@KRBTEST.COM
I20260812 00:09:34.797765 13473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.790824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48118 (local address 127.19.59.126:40577)
0812 00:09:34.790889 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.790890 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.790898 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:09:34.790917 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.790917 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.790926 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.790993 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.791432 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.791880 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.792799 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.792989 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.793066 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.795119 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:34.795120 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:34.795120 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:34.795127 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:34.796581 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.796956 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.796958 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.796958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.797026 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.797257 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.797258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.797258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.797371 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:34.797551 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:34.797593 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 00:09:34.797664 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:09:34.798949 13637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.792513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:45269 (local address 127.0.0.1:40922)
0812 00:09:34.792602 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.792611 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:34.792655 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:34.792780 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:34.792780 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:34.792906 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:34.792925 (+ 19us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.792926 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.793439 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.793440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.793901 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.793907 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.794710 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.794711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.794782 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.795175 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:34.795180 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:34.796310 (+ 1130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:34.798050 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.798051 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.798051 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.798225 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.798398 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.798399 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.798399 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.798455 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.798675 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:34.798676 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:34.798710 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:09:34.798767 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 00:09:34.798855 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260812 00:09:34.798996 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.792570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40922 (local address 127.19.59.124:45269)
0812 00:09:34.792602 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.792604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.792641 (+ 37us) server_negotiation.cc:407] Connection header received
0812 00:09:34.792706 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.792707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.792715 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.792766 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.792995 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.793373 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.793985 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.794185 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.794256 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.796423 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:34.796424 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:34.796424 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:34.796431 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:34.797953 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.798285 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.798286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.798286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.798343 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.798514 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.798515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.798515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.798607 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:34.798672 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:34.798794 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 00:09:34.798898 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":15}
I20260812 00:09:34.800565 13635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0: Bootstrap starting.
I20260812 00:09:34.801338 13635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:34.801618 13635 log.cc:824] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:34.802289 13635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0: No bootstrap required, opened a new log
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.59.125@KRBTEST.COM
I20260812 00:09:34.803850 13635 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } }
I20260812 00:09:34.803951 13635 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cf8915cd55b4bba818cc5482bd799f0, State: Initialized, Role: FOLLOWER
I20260812 00:09:34.804024 13635 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } }
I20260812 00:09:34.804327 13635 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:34.804342 13641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } } }
I20260812 00:09:34.804486 13641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:09:34.805678 13555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.798405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60600 (local address 127.19.59.125:44117)
0812 00:09:34.798445 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.798446 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.798523 (+ 77us) server_negotiation.cc:407] Connection header received
0812 00:09:34.798593 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.798594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.798604 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.798653 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.799293 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.799848 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.800406 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.800613 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.800678 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.802903 (+ 2225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:34.802905 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:34.802905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:34.802911 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:34.804256 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.804681 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.804682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.804682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.804739 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.805002 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.805002 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.805003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.805112 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:34.805226 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:34.805515 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 00:09:34.805591 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:09:34.806633 13558 master_runner.cc:186] Error getting master registration for 127.19.59.126:40577: OK, instance_id { permanent_uuid: "08f422e8e74944628391a3392c475c69" instance_seqno: 1786493374464086 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:09:34.809381 13558 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 00:09:34.809558 13654 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:09:34.809605 13654 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:09:34.809775 13471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } attempt: 2
I20260812 00:09:34.810240 19693 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:09:34.811364 13441 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "08f422e8e74944628391a3392c475c69"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48118
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.126@KRBTEST.COM for kudu/127.19.59.124@KRBTEST.COM
I20260812 00:09:34.816442 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.810079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40934 (local address 127.19.59.124:45269)
0812 00:09:34.810113 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.810115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.810123 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:09:34.810169 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.810170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.810178 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.810245 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.810524 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.810914 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.811867 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.812129 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.812194 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.813904 (+ 1710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:34.813905 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:34.813906 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:34.813912 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:34.815348 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.815650 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.815651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.815651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.815700 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.815890 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.815890 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.815891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.816032 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:34.816129 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:34.816290 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 00:09:34.816359 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:09:34.816447 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.810034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:45269 (local address 127.0.0.1:40934)
0812 00:09:34.810077 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.810085 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:34.810117 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:34.810252 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:34.810253 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:34.810401 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:34.810438 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.810439 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.811019 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.811020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.811771 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.811774 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.812219 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.812220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.812278 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.812654 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:34.812657 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:34.813836 (+ 1179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:34.815412 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.815412 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.815413 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.815575 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.815767 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.815768 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.815768 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.815822 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.816135 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:34.816135 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:34.816179 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 00:09:34.816265 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 00:09:34.816358 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:09:34.818157 13471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69: Bootstrap starting.
I20260812 00:09:34.818710 13471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:34.818997 13471 log.cc:824] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:34.819708 13471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69: No bootstrap required, opened a new log
I20260812 00:09:34.820636 13471 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } }
I20260812 00:09:34.820748 13471 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08f422e8e74944628391a3392c475c69, State: Initialized, Role: FOLLOWER
I20260812 00:09:34.820828 13471 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } }
I20260812 00:09:34.821115 13471 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:09:34.821079 13657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } } }
I20260812 00:09:34.821167 13657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:09:34.821336 13441 raft_consensus.cc:482] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 00:09:34.821408 13441 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:34.822167 13441 raft_consensus.cc:504] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } }
I20260812 00:09:34.822468 13441 leader_election.cc:288] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [CANDIDATE]: Term 1 election: Requested vote from peers 7bcb14322d254b8383ed227970c8db27 (127.19.59.125:44117), 9cf8915cd55b4bba818cc5482bd799f0 (127.19.59.124:45269)
W20260812 00:09:34.823535 13669 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:09:34.823575 13669 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:09:34.823495 13394 master_runner.cc:186] Error getting master registration for 127.19.59.125:44117: OK, instance_id { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" instance_seqno: 1786493374618594 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:09:34.824918 13394 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:09:34.825166 13607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "08f422e8e74944628391a3392c475c69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9cf8915cd55b4bba818cc5482bd799f0"
I20260812 00:09:34.825284 13607 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:34.826159 13607 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08f422e8e74944628391a3392c475c69 in term 1.
I20260812 00:09:34.826400 13415 leader_election.cc:302] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08f422e8e74944628391a3392c475c69, 9cf8915cd55b4bba818cc5482bd799f0; no voters:
I20260812 00:09:34.826541 13657 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:09:34.826747 13657 raft_consensus.cc:686] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [term 1 LEADER]: Becoming Leader. State: Replica: 08f422e8e74944628391a3392c475c69, State: Running, Role: LEADER
I20260812 00:09:34.826838 13657 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } }
I20260812 00:09:34.827291 13676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08f422e8e74944628391a3392c475c69. Latest consensus state: current_term: 1 leader_uuid: "08f422e8e74944628391a3392c475c69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } } }
I20260812 00:09:34.827527 13676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:34.827852 13678 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:09:34.828022 13678 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:09:34.829463 13607 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0 [term 1 FOLLOWER]: Refusing update from remote peer 08f422e8e74944628391a3392c475c69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:09:34.829768 13676 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:09:34.831147 13641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08f422e8e74944628391a3392c475c69. Latest consensus state: current_term: 1 leader_uuid: "08f422e8e74944628391a3392c475c69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } } }
I20260812 00:09:34.831243 13641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:09:34.839891 13473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.830079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48130 (local address 127.19.59.126:40577)
0812 00:09:34.830116 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.830118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.830485 (+ 367us) server_negotiation.cc:407] Connection header received
0812 00:09:34.830649 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.830650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.830673 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.830704 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.831603 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.832670 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.833608 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.833907 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.833977 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.835974 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:34.835975 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:34.835976 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:34.836001 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:34.837947 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.838693 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.838708 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.838709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.838768 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.839141 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.839142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.839142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.839261 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:34.839340 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:34.839724 (+ 384us) server_negotiation.cc:299] Negotiation successful
0812 00:09:34.839799 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:09:34.842871 13676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "08f422e8e74944628391a3392c475c69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } } }
I20260812 00:09:34.842949 13676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:34.843230 13679 mvcc.cc:205] Tried to move back new op lower bound from 7317476863299051520 to 7317476863291359232. Current Snapshot: MvccSnapshot[applied={T|T < 7317476863299051520}]
I20260812 00:09:34.843463 13641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "08f422e8e74944628391a3392c475c69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } } }
I20260812 00:09:34.843544 13641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:09:34.843750 13684 mvcc.cc:205] Tried to move back new op lower bound from 7317476863299051520 to 7317476863291359232. Current Snapshot: MvccSnapshot[applied={T|T < 7317476863299051520}]
I20260812 00:09:34.844384 13555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.830129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60606 (local address 127.19.59.125:44117)
0812 00:09:34.830165 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.830166 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.833980 (+ 3814us) server_negotiation.cc:407] Connection header received
0812 00:09:34.834344 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.834345 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.834355 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.834382 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.835069 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.835684 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.837657 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.838320 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.838361 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.841512 (+ 3151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:34.841513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:34.841513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:34.841520 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:34.843047 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.843385 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.843386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.843386 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.843433 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.843805 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.843806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.843806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.843938 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:34.844011 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:34.844232 (+ 221us) server_negotiation.cc:299] Negotiation successful
0812 00:09:34.844303 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:09:34.848600 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.830414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40950 (local address 127.19.59.124:45269)
0812 00:09:34.830447 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.830449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.836905 (+ 6456us) server_negotiation.cc:407] Connection header received
0812 00:09:34.837011 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.837012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.837022 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.837061 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.839923 (+ 2862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.840556 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.841499 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.841755 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.841913 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.845228 (+ 3315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:34.845229 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:34.845230 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:34.845237 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:34.847245 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.847763 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.847764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.847764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.847839 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.848066 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.848067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.848067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.848177 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:34.848263 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:34.848449 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 00:09:34.848521 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:09:34.848766 13678 catalog_manager.cc:1347] Generated new cluster ID: 9d4d5f8b9a424561ad71809c42805e51
I20260812 00:09:34.848824 13678 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:09:34.850797 13551 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } attempt: 3
Aug 12 00:09:34 dist-test-slave-6nmv krb5kdc[13380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493374, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.59.125@KRBTEST.COM for kudu/127.19.59.124@KRBTEST.COM
I20260812 00:09:34.861143 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.851081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.59.124:45269 (local address 127.0.0.1:40956)
0812 00:09:34.853847 (+ 2766us) negotiation.cc:107] Waiting for socket to connect
0812 00:09:34.853857 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:09:34.853906 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:09:34.854106 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:09:34.854107 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:09:34.854243 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:09:34.854276 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.854277 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.855005 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.855006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.855717 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:09:34.855719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.856188 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.856189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:09:34.856247 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.856645 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:09:34.856650 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:09:34.858088 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:09:34.860001 (+ 1913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.860002 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.860002 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.860223 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.860487 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:09:34.860488 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:09:34.860488 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:09:34.860566 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:09:34.860866 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:09:34.860866 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:09:34.860917 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 00:09:34.860977 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:09:34.861059 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2750}
I20260812 00:09:34.861567 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:34.851116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40956 (local address 127.19.59.124:45269)
0812 00:09:34.851146 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.851148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.853904 (+ 2756us) server_negotiation.cc:407] Connection header received
0812 00:09:34.854029 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.854030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.854038 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.854076 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.854349 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.854917 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.855797 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:34.856104 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:34.856189 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:34.858175 (+ 1986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:09:34.858176 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:09:34.858176 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:09:34.858182 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:09:34.859884 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.860332 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.860333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.860334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.860402 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:09:34.860641 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:09:34.860642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:09:34.860642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:09:34.860759 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:09:34.860814 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:34.861425 (+ 611us) server_negotiation.cc:299] Negotiation successful
0812 00:09:34.861492 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 00:09:34.863269 13551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27: Bootstrap starting.
I20260812 00:09:34.863679 13678 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:09:34.863981 13551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27: Neither blocks nor log segments found. Creating new log.
I20260812 00:09:34.864284 13678 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:09:34.864267 13551 log.cc:824] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27: Log is configured to *not* fsync() on all Append() calls
I20260812 00:09:34.866235 13551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27: No bootstrap required, opened a new log
I20260812 00:09:34.868127 13551 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } }
I20260812 00:09:34.868240 13551 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bcb14322d254b8383ed227970c8db27, State: Initialized, Role: FOLLOWER
I20260812 00:09:34.868304 13551 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } }
I20260812 00:09:34.868589 13551 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 00:09:34.869786 13500 tablet.cc:2369] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:09:34.870658 13523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "08f422e8e74944628391a3392c475c69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7bcb14322d254b8383ed227970c8db27"
I20260812 00:09:34.870750 13523 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:09:34.870759 13678 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69: Generated new TSK 0
I20260812 00:09:34.870891 13678 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:09:34.872340 13523 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08f422e8e74944628391a3392c475c69 in term 1.
I20260812 00:09:34.872762 13521 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27 [term 1 FOLLOWER]: Refusing update from remote peer 08f422e8e74944628391a3392c475c69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:09:34.873311 13657 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:09:34.874886 13704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08f422e8e74944628391a3392c475c69. Latest consensus state: current_term: 1 leader_uuid: "08f422e8e74944628391a3392c475c69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } } }
I20260812 00:09:34.875043 13704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:09:34.875134 13704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "08f422e8e74944628391a3392c475c69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } } }
I20260812 00:09:34.875227 13704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:09:34.878088 13689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "08f422e8e74944628391a3392c475c69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } } }
I20260812 00:09:34.878166 13689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:09:34.878367 13702 mvcc.cc:205] Tried to move back new op lower bound from 7317476863466311680 to 7317476863291359232. Current Snapshot: MvccSnapshot[applied={T|T < 7317476863299051520}]
W20260812 00:09:34.878728 13700 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:09:34.878818 13700 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 00:09:34.902781 13473 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:34.900985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48132 (local address 127.19.59.126:40577)
0812 00:09:34.901024 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.901026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.902077 (+ 1051us) server_negotiation.cc:407] Connection header received
0812 00:09:34.902198 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.902199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.902217 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.902247 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.902681 (+ 434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48132: BlockingRecv error: recv got EOF from 127.0.0.1:48132 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 00:09:34.903671 13639 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:34.901300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40958 (local address 127.19.59.124:45269)
0812 00:09:34.901336 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.901337 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.903200 (+ 1863us) server_negotiation.cc:407] Connection header received
0812 00:09:34.903303 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.903304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.903313 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.903337 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.903619 (+ 282us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40958: BlockingRecv error: recv got EOF from 127.0.0.1:40958 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 00:09:34.904516 13555 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:34.901608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60620 (local address 127.19.59.125:44117)
0812 00:09:34.901644 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.901646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.904049 (+ 2403us) server_negotiation.cc:407] Connection header received
0812 00:09:34.904136 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.904138 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.904146 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.904174 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.904468 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60620: BlockingRecv error: recv got EOF from 127.0.0.1:60620 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 00:09:34.906956 13555 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:34.906223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60624 (local address 127.19.59.125:44117)
0812 00:09:34.906256 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.906258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.906459 (+ 201us) server_negotiation.cc:407] Connection header received
0812 00:09:34.906560 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.906561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.906577 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.906605 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.906912 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60624: BlockingRecv error: recv got EOF from 127.0.0.1:60624 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 00:09:34.909874 13555 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:34.909146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60628 (local address 127.19.59.125:44117)
0812 00:09:34.909173 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.909175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.909374 (+ 199us) server_negotiation.cc:407] Connection header received
0812 00:09:34.909461 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.909461 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.909470 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.909495 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.909808 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60628: BlockingRecv error: recv got EOF from 127.0.0.1:60628 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260812 00:09:34.913998 13555 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:34.913045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60638 (local address 127.19.59.125:44117)
0812 00:09:34.913082 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.913083 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.913298 (+ 215us) server_negotiation.cc:407] Connection header received
0812 00:09:34.913402 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.913403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.913472 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.913519 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.913956 (+ 437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60638: BlockingRecv error: recv got EOF from 127.0.0.1:60638 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 00:09:34.919831 13555 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:34.919113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60650 (local address 127.19.59.125:44117)
0812 00:09:34.919144 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.919146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.919359 (+ 213us) server_negotiation.cc:407] Connection header received
0812 00:09:34.919465 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.919466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.919475 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.919501 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.919794 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60650: BlockingRecv error: recv got EOF from 127.0.0.1:60650 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 00:09:34.929980 13555 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:34.929077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60654 (local address 127.19.59.125:44117)
0812 00:09:34.929109 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.929111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.929352 (+ 241us) server_negotiation.cc:407] Connection header received
0812 00:09:34.929467 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.929468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.929478 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.929509 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.929925 (+ 416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60654: BlockingRecv error: recv got EOF from 127.0.0.1:60654 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260812 00:09:34.948415 13555 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:34.947446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60658 (local address 127.19.59.125:44117)
0812 00:09:34.947487 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.947490 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.947794 (+ 304us) server_negotiation.cc:407] Connection header received
0812 00:09:34.947905 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.947907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.947920 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.947951 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.948356 (+ 405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60658: BlockingRecv error: recv got EOF from 127.0.0.1:60658 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 00:09:34.982832 13555 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:34.981934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60668 (local address 127.19.59.125:44117)
0812 00:09:34.981974 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:34.981976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:34.982251 (+ 275us) server_negotiation.cc:407] Connection header received
0812 00:09:34.982350 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:34.982352 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:34.982363 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:34.982392 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:34.982774 (+ 382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60668: BlockingRecv error: recv got EOF from 127.0.0.1:60668 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 00:09:35.048987 13555 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:35.048309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60680 (local address 127.19.59.125:44117)
0812 00:09:35.048380 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:35.048383 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:35.048460 (+ 77us) server_negotiation.cc:407] Connection header received
0812 00:09:35.048495 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:35.048496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:35.048510 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:35.048599 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:35.048926 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60680: BlockingRecv error: recv got EOF from 127.0.0.1:60680 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260812 00:09:35.178857 13555 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:35.178076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60696 (local address 127.19.59.125:44117)
0812 00:09:35.178158 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:35.178160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:35.178285 (+ 125us) server_negotiation.cc:407] Connection header received
0812 00:09:35.178376 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:35.178379 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:35.178394 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:35.178455 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:35.178810 (+ 355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60696: BlockingRecv error: recv got EOF from 127.0.0.1:60696 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260812 00:09:35.436743 13555 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:09:35.436155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60704 (local address 127.19.59.125:44117)
0812 00:09:35.436248 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:35.436249 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:35.436261 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:09:35.436287 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:35.436288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:35.436299 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:35.436364 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:09:35.436696 (+ 332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60704: BlockingRecv error: recv got EOF from 127.0.0.1:60704 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 00:09:35.457775 13657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "08f422e8e74944628391a3392c475c69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f422e8e74944628391a3392c475c69" member_type: VOTER last_known_addr { host: "127.19.59.126" port: 40577 } } peers { permanent_uuid: "7bcb14322d254b8383ed227970c8db27" member_type: VOTER last_known_addr { host: "127.19.59.125" port: 44117 } } peers { permanent_uuid: "9cf8915cd55b4bba818cc5482bd799f0" member_type: VOTER last_known_addr { host: "127.19.59.124" port: 45269 } } }
I20260812 00:09:35.457971 13657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08f422e8e74944628391a3392c475c69 [sys.catalog]: This master's current role is: LEADER
I20260812 00:09:35.810041 13654 catalog_manager.cc:1259] Loaded cluster ID: 9d4d5f8b9a424561ad71809c42805e51
I20260812 00:09:35.810103 13654 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0: loading cluster ID for follower catalog manager: success
I20260812 00:09:35.810853 13654 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0: acquiring CA information for follower catalog manager: success
I20260812 00:09:35.811084 13654 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9cf8915cd55b4bba818cc5482bd799f0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:09:35.879365 13700 catalog_manager.cc:1259] Loaded cluster ID: 9d4d5f8b9a424561ad71809c42805e51
I20260812 00:09:35.879443 13700 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27: loading cluster ID for follower catalog manager: success
I20260812 00:09:35.880268 13700 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27: acquiring CA information for follower catalog manager: success
I20260812 00:09:35.880527 13700 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7bcb14322d254b8383ed227970c8db27: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:09:35.952458 13787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:35.950005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60720 (local address 127.19.59.125:44117)
0812 00:09:35.950161 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:35.950162 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:35.950174 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:09:35.950233 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:35.950234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:35.950281 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:35.950362 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:09:35.950502 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:35.951014 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:35.951730 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:35.951940 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:35.951994 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:35.952151 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:09:35.952251 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:09:35.952340 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:35.952357 (+ 17us) server_negotiation.cc:299] Negotiation successful
0812 00:09:35.952381 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":110,"threads_started":1}
I20260812 00:09:35.956723 13793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:35.954299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40960 (local address 127.19.59.124:45269)
0812 00:09:35.954410 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:35.954412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:35.954421 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:09:35.954521 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:35.954521 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:35.954566 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:35.954655 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:09:35.954740 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:35.955203 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:35.955878 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:35.956127 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:35.956209 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:35.956382 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:09:35.956483 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:09:35.956566 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:35.956619 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 00:09:35.956639 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":61,"threads_started":1}
I20260812 00:09:35.960863 13787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:35.958298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60732 (local address 127.19.59.125:44117)
0812 00:09:35.958343 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:35.958345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:35.958514 (+ 169us) server_negotiation.cc:407] Connection header received
0812 00:09:35.958631 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:35.958633 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:35.958644 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:35.958700 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:09:35.958869 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:35.959284 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:35.960169 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:35.960445 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:35.960504 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:35.960651 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:09:35.960678 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:09:35.960724 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:35.960777 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 00:09:35.960795 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:09:35.961189 13793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:35.958414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40970 (local address 127.19.59.124:45269)
0812 00:09:35.958454 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:35.958456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:35.958627 (+ 171us) server_negotiation.cc:407] Connection header received
0812 00:09:35.958726 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:35.958727 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:35.958736 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:35.958760 (+ 24us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:09:35.958915 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:35.959566 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:35.960471 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:35.960744 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:35.960795 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:35.960955 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:09:35.960983 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:09:35.961010 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:35.961108 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 00:09:35.961126 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:09:35.961421 13799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:09:35.958191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48144 (local address 127.19.59.126:40577)
0812 00:09:35.958372 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 00:09:35.958374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:09:35.958430 (+ 56us) server_negotiation.cc:407] Connection header received
0812 00:09:35.958560 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:09:35.958561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:09:35.958613 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:09:35.958709 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:09:35.958806 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:35.959547 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:35.960508 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:09:35.960808 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:09:35.960843 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:09:35.961079 (+ 236us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:09:35.961171 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:09:35.961206 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0812 00:09:35.961318 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 00:09:35.961342 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260812 00:09:35.963012 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 13394
I20260812 00:09:35.971973 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 13478
I20260812 00:09:35.979740 19693 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBmexS9/build/release/bin/kudu with pid 13558
2026-08-12T00:09:35Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2784 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5592 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (266125 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST